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Abstract 



A cellular game is a dynamical system in which ceUs, placed in some discrete structure, are 
regarded as playing a game with their immediate neighbors. Individual strategies may be 
either deterministic or stochastic. Strategy success is measured according to some universal 
and unchanging criterion. Successful strategies persist and spread; unsuccessful ones disappear. 

In this thesis, two cellular game models are formally defined, and are compared to cellular 
automata. Computer simulations of these models are presented. 

Conditions providing maximal average cell success, on one and two-dimensional lattices, are 
examined. It is shown that these conditions are not necessarily stable; and an example of such 
instability is analyzed. It is also shown that Nash equilibrium strategies are not necessarily 
stable. 

Finally, a particular kind of zero-depth, two-strategy cellular game is discussed; such a 
game is called a simple cellular game. It is shown that if a simple cellular game is left/right 
symmetric, and if there are initially only finitely many cells using one strategy, the zone in 
which this strategy occurs has probability of expanding arbitrarily far in one direction only. 
With probability 1, it will cither expand in both directions or disappear. 

Computer simulations of such games are presented. These experiments suggest the existence 
of two different kinds of asymptotic behavior. 
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Chapter 1 



Introduction 

A cellular game is a dynamical system; that is, the variables it is composed of are regarded as 
changing over time. These variables or cells, arranged in a discrete structure such as a ring, are 
thought of as repeatedly playing a game with their neighbors. Most of this paper is concerned 
with one-dimensional cellular games, defined more formally as follows: 

Definition 1.1 A one-dimensional cellular game consists of: 

1. A one- dimensional discrete structure, uniform from the viewpoint of each site; that is, a 
ring or doubly infinite path. 

2. A variable, or cell, at each site. The components of this variable may change at each 
discrete unit of time, or round. They consist of, at least: 

(a) A move component, which can take on a finite number k of values. 

(b) A strategy component, which determines what move a cell makes in a given round. 
The strategy of a cell is based on past moves of it and its r nearest neighbors on each 
side. The number of past rounds considered is called the depth d of the strategy. 
This r, as used above, is the radius of the game. 

3. A fitness criterion, which does not change and is the same for each cell. This fitness 
criterion is usually local; that is, the fitness of a cell in each round is based on its move, 
and those of nearest neighbors within the radius of the game. 
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4- A mechanism for strategy selection, under which more fit strategies survive and spread. 
Strategy selection is usually nonlocal; that is, a more fit strategy may spread arbitrarily 
far in a fixed number of time units. An interval between strategy changes, which may be 
one or more rounds, is called a generation. 

Thus, a cellular game can be considered a process in which cells make moves each round, 
based on their strategies, and strategies are updated in each generation, based on their fitness 
in preceding rounds. 

Note that cellular game strategies and fitness criteria are usually stored in the form of a 
table. Also note that n-dimensional cellular automata, with one cell for each n-tuple of integers 
or integers mod k, can be similarly defined. 



One-dimensional cellular games are studied in ||2^, y], y], and [13|. Similar systems are 



discussed in [IC], [11| and and games on a two-dimensional lattice in |15]. 

Cellular games satisfy a criterion for "artificial life" as discussed by Christopher Langton 
1^]. That is, "There are no rules in the system that dictate global behavior. Any behavior at 
levels higher than the (individual cells) is, therefore, emergent." 

Cellular games are a generalization and extension of another, more well-known, discrete 
dynamical system; that is, of cellular automata. They were created largely because of ques- 
tions arising from the observation of cellular automata. One-dimensional cellular automata are 
defined as follows: 

Definition 1.2 A one-dimensional cellular automaton consists of: 

• A one- dimensional discrete structure, uniform from the viewpoint of each site; that is, a 
ring or doubly infinite path. 

• A variable, or cell, at each site, that can take on finitely many values or states. The 
initial states of a cell may be specified as desired. 

• A function which decides how each cell changes state from one generation, or discrete 
unit of time, to the next. This function, or cellular automaton rule, is always the 
same for each cell, and depends entirely on the state of a cell and that of its r neighbors 
on each side in the past m generations. This r is referred to as the radius of the cellular 
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automaton, and m as its order. Cellular automaton rules are usually stored and described 
in the form of a table. 



It can be shown that a mth-order cellular automaton is equivalent to a first-order cellular 
automaton with more states. This proof [|2^, however, is dependent on the locality of cellular 
automata - that is, on the fact that cells are directly affected only by their neighbors. For 
similar mathematical objects, such as cellular games, that are not local, this proof cannot be 
used. 

Thus, if a cellular automaton, of radius r, operates on cells that can take k possible states, 
there are k"^"^^^ possible circumstances that need to be considered. The rule table, therefore, 
has k'^^'^^ entries; and there are k^^^^^ possible r-radius, A;-state cellular automaton rules. 
An example of a cellular automaton rule is the two-state, radius one rule whose evolution is 
illustrated below. In this rule, a cell can be in either state or state 1. Any cell that, in 
generation g is in state 1, and has both of its neighbors in state 1, stays in state 1 in generation 
(7 + 1. Otherwise, a cell is in state in generation g + 1. This rule is Rule 128 according to 



Wolfram's [24| classification system of the 256 2-state, radius one rules. 



Generation 1: 1011110101 
Generation 2: 0001100000 
Generation 3: 0000000000 



Table 1.3 The action of rule 128 on a circular ring of ten cells, for three generations. 

Definition 1.4 A stochastic cellular automaton is as above, except that neighborhood 
states do not determine the move made in the next generation, but the probability that a par- 
ticular move will be made. 

Computer experiments on one-dimensional cellular automata are usually conducted with 
cells arranged in a ring. Cell states are indicated by colors; thus, /c-state cellular automaton rules 
are often referred to as /c-color rules. Initial conditions are displayed in a line on top of the screen, 
with each generation being displayed below the previous generation. In such experiments, initial 
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conditions, and rule table entries, are often chosen with the aid of a pseudorandom number 
generator. 

As a matter of fact, descriptions of computer experiments with cellular automata and other 
discrete dynamical systems often make reference, informally, to "random" initial conditions. 
This concept actually applies to mathematical models containing infinitely many variables, 
such as a one-dimensional cellular automaton with one cell for each integer. In such a case, 
"random," "almost all," or "normal" initial conditions refer to conditions such that all A;" of 
the n-tuples of k cell states are equally likely, for all n. Or, in other words, if the states of the 
cells are construed as decimal places of two real numbers, both numbers are normal to base k. 

Such conditions cannot be exactly duplicated in the finite case, no matter how large the 
number of cells. However, conditions can be created which appear disordered and satisfy certain 
statistical tests of disorder. This is done with the aid of a pseudorandom number generator. 
Such initial conditions are often loosely referred to as "random." Computer simulations of 
discrete dynamical systems often use such initial conditions as the most feasible indicator of 
likely behavior. 

In such experiments, there are, roughly, three types of asymptotic behavior. First of all, all 
cells may become and remain one color, or change color periodically, with a small and easily 
observable period. Second, cells may display "chaotic" behavior; that is, cell color choice may 
appear to be disordered, or to result from some other simple stochastic algorithm. Third, cell 
color choice may be neither periodic nor chaotic, but appear to display organized complexity. 
That is, the cell evolution diagrams may look like biological structures, such as plants, or social 
structures, such as city maps. As a matter of fact, such diagrams are often quite esthetically 
pleasing. These rule types are discussed in |p5|; for more on the concept of "complexity," as it 



applies to cellular automaton rules, see [122 1. 

On a finite ring of cells, of course, all such evolution is eventually periodic. But, if cells can 
be in 2 states, and there are 640 cells, there are 2^'^^ possible ring states. Therefore the period 
of ring states could, conceivably, be quite high; and "chaotic" or "complex" rules do indeed 
seem to have very high periods. 

Visual representations of cellular automata can exhibit a sophistication reminiscent of living 
structures. However, the number of A;-state, r-radius cellular automaton rules is very large 
^^fe2'"+i-j £^j, the smallest k and r; and "interesting" rules are not common and difficult to 



4 



find. This leads to the question, therefore, of whether there is some way of "evolving" cellular 
automaton rules in a desired direction. 

There are two possible avenues of approach to this question. One is to select rules based 
on their global properties. That is, some computable measure of the desired characteristics is 
devised, and rules are chosen by their ability to meet this measure. Such selections are discussed 
in PI and Q. 



The other way is to select rules based on their local properties. That is, each cell uses 
a different rule; and there is some universal and unchanging criterion for rule success. This 
approach is more like the way living systems evolve, for the evolution of a planetary ecology is 
not due to constraints placed directly on the ecology. It is an emergent property of constraints 
placed on the individual organisms. For this reason, such models may potentially reveal not 
only the nature of "complex" rules, but also how their global properties emerge from local 
interactions. 

An evolutionary model of this sort is equivalent to a cellular game; the only difference is 
the terminology. That is, the strategy of a cell can be regarded as the individual rule used by 
each cell; the depth of the strategy as the order of the rule; cell moves as states; and instead of 
referring to the smallest unit of time as a round, and a possibly larger unit as a generation, the 
smallest unit can, as with cellular automata, be referred to as a generation. The fitness criteria 
and evolutionary process stay the same. 

A cellular game differs from a cellular automaton not only in the precise definition used, 
but also in the philosophy under which this definition was constructed. That is: 

• Cellular automata are often regarded as a physical models; for example, each cell may 
be seen as an individual atom. Thus, the rules by which each cell operates are the same. 
Cellular games, on the other hand, are seen as an evolutionary models. Each cell uses an 
individual rule, or strategy, which can be thought of as the "genetic code" of the cell. 

• Cellular automata are usually thought of as deterministic, beyond the initial genera- 
tion, though stochastic cellular automata have also been studied. Cellular games operate 
stochastically; that is, the evolutionary process under which strategies are modified is 
stochastic, and, often, the strategies themselves are stochastic. 
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• Cellular automata are local; that is, the state of a cell is affected only by the states of its r 
nearest neighbors on each side in the previous generation. In other words, cell information 
cannot travel more than r units per generation. This speed is often called "the speed of 
light." Cellular games, on the other hand, typically use nonlocal strategy selection criteria. 
That is, a more fit strategy may propagate arbitrarily far in one generation. (There is 
more discussion of the nonlocality of cellular games in Section |2.4|.) 



• In [23 1, it is shown that mth-order cellular automata are behaviorally equivalent to first- 
order cellular automata with larger radius and more states. However, this proof does 
not work for cellular games with nonlocal selection criteria. Moreover, cellular games are 
often constructed with strategies looking more than one generation back. 

Now, it can be shown that if a cellular game has a local fitness criterion and local rule 
selection process, it is actually equivalent to a cellular automaton with a large number of 
states. This automaton, of course, will be stochastic if the game is stochastic. 

Theorem 1.5 Let G be a cellular game with a local fitness criterion and local rule selection 
process, which operates every R rounds. Let all fitness measurements start over again after this 
process. Then G is equivalent to a cellular automaton G' with a much larger number of states. 

Proof. Let G' be constructed as follows: let the state of a cell c in G' be a vector with the 
following components: 

1. The state of c in G. 

2. The individual rule used by c, in G. 

3. A i?-valued counting variable, which starts out as 1 in the first generation, and thereafter 
corresponds to the current generation mod R. 

4. A fitness variable, which corresponds to the accumulated fitness of a cell over R rounds. 

Since these components enable G' to simulate the action of G, it suffices to show that G' is 
a cellular automaton. That is, each component must have only finitely many possible values, 
and be locally determined. This is shown to be true for each component, as follows: 
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1. By definition of G, the first component has only finitely many values. It is determined by 
the rule of a cell, and the states of it and its neighbors in preceding rounds. 



2. By definition 1.1, even if stochastic rules are used only finitely many are considered. 
Whether or not a cell keeps its rule, after R rounds, is based on its own fitness, and the 
process of selecting new rules is assumed to be local. 

3. The counting component can be in any one of R different states. The rule for its change 
is simple: If it is in state s in round d, it is in state s + 1 mod g in round d + 1. Note 
that to run G' as a simulation of G, this counting component must be initially set at the 
same value for all cells. 

4. The fitness component is set to zero after every R rounds; and can be incremented or 
decremented in only finitely many different ways. How it changes in each generation, for 
a given cell c, depends on the first components of cells c — r through c + r. 



Given this equivalence, why, then, is a cellular game so different from a cellular automaton? 
For one thing, cellular games often do use a nonlocal strategy selection process; it may be 
considered an approximation to a selection process that can operate over very large distances. 
For another, cellular automaton rule spaces, especially those with high radius, typically contain 
very large numbers of rules. Therefore, even if only systems with a local selection process are 
considered, the evolutionary paradigm of cellular games may still be valuable. It may be a 
practical method of selecting members of these spaces with interesting properties. 

In this paper, two different models of cellular games are defined. The original Arthur- 



Packard- Rogers model is discussed first in Section 2.2. This model is quite extensive and uses 



many different parameters. The second, simplified, model is more amenable to mathematical 



analysis. This model is discussed in Section 2.4 



Computer simulations of both models are presented. These simulations are similar to those 
of cellular automata, both in the way they are conducted and in the way they are displayed. 
That is, cell moves are indicated by colors. Strategies are usually not pictured, due to the large 
size of strategy spaces. Thus, the move of a cell may also be referred to as its color. Initial 
moves of a finite ring of cells are displayed in a line on top of the screen, and each generation is 
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displayed below the previous generation. Initial moves and strategies, as well as other stochastic 
choices during the course of the game, are implemented with the aid of a pseudorandom number 
generator. 

Computer simulations of the first model display sophisticated behavior reminiscent of living 
systems, or "complicated" cellular automata. These behaviors, which include such phenomena 
as zone growth and "punctuated equilibria," are discussed and extensively illustrated in Section 



2.3 



The second model admits only deterministic strategies of depth zero; that is, strategies 
of the form, "Do move m, without regard to previous rounds." Thus, in this model, moves 
and strategies can be considered equivalent. Though this model is simpler, there are still 
counterintuitive results associated with it. Even if only two strategies are allowed under this 
model, it is extremely difficult to predict which, if either, will be stable under invasion by the 
other. There are no simple algorithms for determining this. 



For example, consider ring viability, discussed in Section 'Lb. For finite rings this concept, 
Definition ^.10| , refers to the average success of all cells in the ring. In this chapter, it is shown 
that under any local fitness criterion G, rings in which the cells have made periodic move 
sequences have the highest possible viability. It is also shown that a similar result is false in 
the two-dimensional case. 

Now, if cellular games did indeed always evolve towards highest ring viability, this would 



make their course relatively easy to predict. However, in Section 2.(:, a two-strategy cellular 
game is presented, in which the best strategy for the ring as a whole - that is, the strategy that, 
if every cell follows it, maximizes ring viability - is not stable under invasion. This instability is 
illustrated by computer simulations, and is also proved. This is done by showing that if a small 
number of cells using the invading strategy are surrounded by large numbers that are not, the 
invading strategy tends to spread in the next generation. The reason for this is that the first 
strategy, though it does well against itself, does poorly against the second one. 

On the other hand, a winning strategy may not necessarily be stable either. That is, strategy 
A may defeat strategy B, but still be unable to resist invasion by it. The reason, in this case, 
is that strategy B does so much better against itself. This result can also be demonstrated by 
computer simulations and proved, using the same method. These results are also in Section 
2:6. 
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Finally, consider a situation in which, if its neighbors use strategy A, a cell has greatest 
success if it uses strategy A too. It seems logical that, in this case, strategy A would indeed 
be stable. As a matter of fact, such a situation is called, in game theory, a symmetric Nash 
equilibrium. 

However, it can be demonstrated by computer simulations, and also proved, that some 
symmetric Nash equilibrium strategies are not stable under invasion. The reason, in such cases, 
is that strategy B has somewhat less probability of surviving in a strategy A environment, but 
is very good at causing strategy A not to survive. Therefore strategy B is somewhat less likely 



to persist, but is a lot more likely to spread. This result is also considered in Section 2.6. 

Thus, the three theorems in Section p.6| show how difficult it is to predict the course of 
cellular games, even under a very simple model. The counterintuitive nature of the results 
obtained suggests the potential mathematical interest of this paradigm. 

The second part of this thesis presents results applicable to particular examples of the zero- 
depth model, called simple cellular games. These games have two distinguishing characteristics: 

• There are only two possible strategies; these two strategies are referred to as white, and 
black. 

• Each cell has, at all times, positive probability of either living or not living. 

The theorems discussed in the second part apply to simple cellular games which are left /right 



symmetric. The Double Glider Theorem, 3.14, applies to the evolution of such games under 



initial conditions under which there are only finitely many black cells. The zone of uncertainty 
is defined as the zone between the leftmost and rightmost black cell. It is shown that the 
probability this zone will expand arbitrarily far in one direction only is 0. That is, with 
probability 1, it will either expand in both directions or disappear. 



Section |3.3| , which follows, discusses simple game evolution in a slightly different con- 
text; that is, under conditions such that there is a leftmost white cell and a rightmost black 
cell, or standard restricted initial conditions. Simple cellular games with both left/right and 
black/white symmetry are classified according to their asymptotic behavior under these circum- 
stances. That is, they are divided into mixing processes and clumping processes. The behavior 
of clumping processes is further explored, and a conjecture is made that applies to both kinds 
of processes. 
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In Section 3^, the last chapter, specific examples of simple cellular games are presented. 
Computer simulations suggest that one of these examples, the Join or Die Process, is a clumping 
process; and the other, the Mixing Process, is, as named, a mixing process. 
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Chapter 2 



Cellular Game Models 

2.1 Game Theory and Cellular Games 

Success criteria in tabular form, or score tables, are extensively used in game theory. They 
describe the course of any game which can be exactly modelled, for which strategy success can 
be numerically described, and in which all strategies are based on finite, exact information. 
For example, consider the game of Scissors, Paper, Stone; that is, Scissors beats Paper, Paper 

beats Stone, and Stone beats Scissors. Suppose this game is played for one round, and the only 
possible strategies are deterministic. Then the table for this game is (if a win scores 1, tie at .5 
and loss at 0): 

Opponent Scissors Paper Stone 



Player 



Scissors 


.5 


1 





Paper 





.5 


1 


Stone 


1 





.5 


The following 


definition is 


used : 



in game theory: 



Definition 2.1 A mixed strategy is a stochastic strategy; that is, one under which, in some 
specified circumstances, more than one move has positive probability. 
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A table can also be devised for mixed strategies, and for games of more than one round. 
For mixed strategies the table entry describes the expected success. 

For example, suppose the game of Scissors, Paper Stone is played for two rounds, and there 
are three possible strategies. Strategy A is to choose each move with probability |, Strategy B 
is to choose Stone for the first move, and the move chosen by the other player for the second, 
and Strategy C is always to choose Paper. Then the table for this game is: 

Opponent Strategy A Strategy B Strategy C 
Player 

Strategy A 1 1 1 

Strategy B 1 1 .5 

Strategy CI 1.5 1 



Definition 2.2 A table depicting strategy success as described above is called the normal form 
of a game. 

Normal form can be used, at least theoretically, to describe extremely sophisticated games. 
For example, if only a fixed finite number of moves are allowed, and strategies consider only 
the history of the current game, then there are only finitely many deterministic strategies for 
the game of chess. Hence normal form could, at least theoretically, be used to describe this 
game. Of course, there are so many possible chess strategies that this form cannot be used for 
practical purposes. For more on normal form, see [^. 

Note that this form is ambiguous if mixed strategies are allowed. For example, consider 
the above table. Does it indicate the actual success levels of deterministic strategies, or the 
expected success levels of stochastic ones? It is not possible to tell without further information. 

Such a normal form can also be used to describe three-player games. For example, this 
table describes a game in which there are two moves, you score .85 if you make the same move 
as both other players and .15 otherwise. This game is called the Join or Die game. 

Your Move: B Your Move: W 
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Player 1: 

Player 2: 

B 

W 



B W 



.85 .15 
.15 .15 



Player 1: 

Player 2: 

B 

W 



B W 



.15 .15 
.15 .85 



Now, consider cellular games. If the success criterion, or score, is local; that is, if it is based 
entirely on the state of a cell and those of its neighbors, it can also be encoded as a table. As 
a matter of fact, any game table for 2r + 1 players can be used as the score table for a cellular 
game of radius r. For example, the Join or Die process is a cellular game of radius 1, in which 
each cell plays the Join or Die game with its two nearest neighbors. The following table is used 
for this process: 

Cell's Move: B Cell's Move: W 



Right Neighbor: B W 

Left Neighbor: 

B .85 .15 

W .15 .15 



Right Neighbor: B W 

Left Neighbor: 

B .15 .15 

W .15 .85 



However, cellular games differ from the situations most analyzed by game theorists, or the 
vernacular notion of a game, in the following ways: 

• Each cell interacts with different neighbors, as determined by the discrete structure on 
which the cellular game is run. That is, the score of cell is based on its move, and those 
of cells 1 and —1. The score of cell 1 is based on the moves of cells and 2, not cells 
and —1. 

• The "game" is considered to be played repeatedly, for many rounds. Thus, the main focus 
is on optimal move behavior in the long run, not for one round only. 
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There is an explicit mechanism for determining how successful strategies thrive and 
spread. The cellular game is not completely described without this mechanism; no as- 
sumptions about asymptotic behavior can be made just on the basis of the score table. 



2.2 The Arthur-Packard-Rogers Model 

The idea of cellular games was first developed by Norman Packard and Brian Arthur at the Santa 



Fe Institute [16|; and first written up by K. C. Rogers, in a Master's thesis at the University of 
Illinois under the direction of Dr. Packard pO[ |. In this model, cells arranged in a ring play a 
game, such as the well-known Prisoner's Dilemma, with each of their nearest neighbors. They 
play for a fixed number of rounds. At the end of these rounds, or of a generation, strategies may 
change. Successful strategies are most likely to spread and persist. The Prisoner's Dilemma is 



discussed in [18], M and Appendix p. 



For details of this model, see Appendix |C|. The terms used are described in Definition LI 



The Arthur-Packard-Rogers model can be summarized as follows: Cells, arranged in a one- 
dimensional structure, play a game, such as the Prisoner's Dilemma, with their neighbors, for 
a predetermined number of rounds. The criteria for success in each round do not change, and 
are the same for each cell. Since the degree of success is based only on the moves of a cell and 
those of its r nearest neighbors on each side, this criterion can be encoded in the form of a 
table. 

The strategies that govern cell move choices may be different for each cell, may be deter- 
ministic or stochastic, are based on past move history, and are stored in the form of a table. 
Strategies may have depth zero, one, or more. 

At the end of these rounds - that is, at the end of a generation - the probability that a 
cell keeps its strategy in the next generation is proportional to the size of its reward variable, 
which measures its success in the game. 

Definition 2.3 Cell death.- A cell is said to die if its strategy is deemed replaceable; that is, 
it is thought of as unsuccessful. The replacing strategy is usually derived from the strategies of 
other cells. 
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Finally, if a cell dies at the end of a generation, the strategy chosen is some combination of 
the strategies of its nearest living neighbors. If it contains elements of both neighbors, crossover 
is said to occur. 

Definition 2.4 Crossover is the existence, in a new strategy, of behavior similar to more than 
one "parent" strategy. 



Definition 2.5 Those cells whose strategies contribute to the new strategy of a cell are called 
its parents. 

There may also be a small probability of strategy table mutation. 

Definition 2.6 A mutation is said to occur when, after a strategy table entry has been chosen 
from a parent cell, it is arbitrarily changed. 

In computer simulations, this is often done with the aid of a pseudorandom number gener- 
ator. 



This model is not quite the same as the original one used in |20|. In that construction, 
strategy replacement was not governed by locality; that is, parent cells were the most successful 
in the ring. Thus, the progenitor of the strategy of a cell was not particularly likely to be nearby. 

In this model, however, parent cells are not necessarily the most successful cells in the ring. 
Instead, they are the nearest living neighbors of a cell. Such a model is more comparable with 
living systems, because it bases system evolution more completely on local properties. It is also 
more easily generalizable to the infinite case, in which there is one cell for each integer. And it 
is only under such a model that one can see the evolution of zones of different strategies. 



2.3 Computer Experiments 

The Arthur-Packard-Rogers model has been simulated in computer experiments, with the aid 
of a pseudorandom number generator. Cell moves are displayed onscreen, in a form similar 
to the display of cellular automaton states. That is, initial moves, for each generation, are 
shown in a line on top of the screen; and moves for each round are shown below the preceding 
round. In experiments simulating the Prisoner's Dilemma, or variations, lighter areas indicate 
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cooperative moves; dark areas, defecting moves. In particular, in the games illustrated in the 
accompanying figures, all strategies are mixed, or stochastic. That is, there is always at least a 
small probability that a move is made other than the one called for by the strategy. 

The experiment illustrated in Figures 1 through 14 simulates a variation of the Prisoner's 
Dilemma, the Stag Hunt. The Stag Hunt is modeled on the dilemma of a member of a pack of 
hunting animals, such as wolves or coyotes. If the whole pack hunts together, they can bring 
down a stag, which is the highest reward. If a member defects, it will be able to get a rabbit 
alone. If the other animals do not defect, they will have a smaller chance of bringing down a 
stag, but it may still be possible; but it is very unlikely that one animal can bring down a stag 
all by itself. Thus, the highest expected reward is for mutual cooperation; next highest, for 
defecting while the other members of the pack cooperate; next, for mutual defection, and fourth, 
for cooperating while the other members of the pack defect. See [|l^] for more information on 
the Stag Hunt; and Appendix ^ for a more technical discussion of the experiments. 

These computer experiments fully suggest the mathematical interest of the subject. They 
reveal thought-provoking behavior, such as: 

• Zone growth. Strategies may not evolve in the same manner in all areas of the ring. 
Zones of cooperative, defecting or other consistent behavior may arise and persist for 
generations. 

• Periodic structures. Cells may alternate between cooperation and defection, or waves of 
cooperation may spread through some or all zones of the ring. 

• "Complexity." Move patterns may display a sophistication reminiscent of living struc- 
tures, or the patterns found in "complex" cellular automata. 

• Long transients. Strategies predominant for hundreds of generations may ultimately dis- 
appear, and be replaced by completely different behavior. 

• "Punctuated equilibria." Move behavior that appears to be stable for many generations 
may, suddenly, change very quickly - and then become stable again, for a long time. 

Note that cellular games cannot be construed to represent any particular living systems, 
social or biological. For one thing, their behavior changes very easily as parameters are mod- 
ified; it is difficult to tell which features are essential, or appropriate to any particular model. 
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However, the existence of the above characteristics suggests that cellular games are evocative 
of biological evolution. It seems possible that the two will turn out to have some features in 
common. 

2.4 The Zero-Depth Model 

Now, these experiments well suggest the richness of behavior cellular games offer. The sophis- 
tication of patterns displayed provides ample justification for further study of this paradigm. 
But the Arthur-Packard-Rogers model does not lend itself well to mathematical analysis. Its 
computer implementation is lengthy and contains many modifiable parameters. It is difficult 
to decide if any behavior exhibited is general, or just an artifact of the specific algorithms used. 

To facilitate mathematical discussion of cellular game behavior, it is hence appropriate 
to simplify the model. Extensive study has been performed on such a model, exhibiting the 
following simplifications: 

• Elimination of crossover. The Arthur-Packard- Rogers model allows crossover. (Definition 




In the simplified model, crossover is eliminated, and each new strategy is an exact copy 
of one that already exists. A rationale for this simplification, in terms of living systems, 
is that one is considering the evolution of a specific gene, which spreads on an either-or 
basis. However, a particular gene may be significant only in the context of other factors. 
It may thus not be appropriate to consider this gene on its own. Note that computer 
experiments using genetic algorithms reinforce the significance of crossover (see [^). 

• Elimination of mutation. Another simplification is the elimination of mutation (Definition 
|2.6| ). That is, after the initial round, any strategy is new for a specific cell only, and is 
a copy of the strategy used by an existing cell. Particularly without crossover, this 
elimination is actually likely to change the long-term behavior of the system. For example, 
suppose strategy A is successful against all other strategies, including itself. If a ring of 
cells is originally free of strategy A, but mutation is allowed, strategy A will eventually 
take over the ring. If there is no mutation, the ring will stay free of it. However, the 
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behavior of a cellular game that allows mutation may best be understood in terms of, and 
in comparison to, the behavior of the simpler system. 

• One round per generation. That is, cell strategy may change after each round of play. 

• Elimination of mixed strategies. Strategies are deterministic, not stochastic. 

• Elimination of depth. The final simplification is the elimination of depth. That is, all 
strategies are executed without regard to past moves. Since there are no mixed strate- 
gies, the strategy, then, just becomes "do move m," and the move variable can thus be 
eliminated from the description of the game. 

The question of how depth and round restrictions affect cellular game behavior is a subject 
for future research; however, these restrictions are not as severe as they seem. From game 
theory, we learn that all information about games with extremely sophisticated strategies can 
be conveyed in table form; that is, the "normal" form of a game. The only restriction is that 
strategies must take into account only a finite amount of information; e.g., the course of the 
game, but not anything before or beyond. As previously discussed, such tables can be used as 
the score table for a cellular game; in particular, for a zero-depth, one round per generation 
cellular game. 

As a matter of fact, cellular games of many rounds per generation, and with high-depth 
strategies, can be rewritten as zero-depth one round games - if all strategies take into account 
the current generation only. 

Note that the Arthur-Packard-Rogers model, discussed above, does take into account moves 
in the previous generation. However, it could easily be modified not to do so, by providing 
table entries to use when there is limited information about previous rounds. For example, 
there could be an entry for the move used if nothing is known about previous moves. 

Theorem 2.7 Let G be a cellular game of radius r, with R rounds per generation, and strategies 
of depth d - except that all strategies take into account only moves in the current generation. 
Then the action of G can be exactly simulated by a cellular game G' of zero depth and one 
round per generation. 
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Proof. It suffices to sfiow tfiat for every sucli game G there is a zero-deptli, one round cellular 
game G', and a mapping / from strategies in G to strategies in G', sucfi that life probabilities 
correspond. Actions made after cell survival is decided can be the same in each case. 

That is, suppose there are two rings of k cells each, 1 < < oo. Let the first ring run G in 
generation g, and let each cell c use strategy Sc- Let the second ring run G' in that generation, 
and let each cell c' use strategy f{Sc)- Then the probability, at the beginning of g, that c 
survives into the next generation should be the same as the probability that c' does. 

To show that such an / can be constructed, it suffices to show that the probability that, 
under G, at the beginning of a generation, that a cell will live through to the next generation 
is entirely dependent on its strategy, and those of its {R — l)r nearest neighbors on each side. 
For if this is true, a table can be constructed, giving the life probability for cell c if it and 
its neighbors follow strategies Sc-(R-i)r, ■ ■ ■ , Sc, • • • , <S'c+(_R-i)r) a-^d this table can be used to 
create a zero-depth, one round cellular game with corresponding life probabilities. 

Now life probabilities in G, at the end of a generation, are entirely dependent on the move 
histories of that generation. Therefore, to show such strategy dependence, it is only necessary 
to show that the probability, at the beginning of g, that cell c will make move m in generation 
q, is entirely dependent on the strategies of c and those of its {q — l)r neighbors on each side. 

This is trivially true in the first round of a generation. Since a cell has no information about 
past moves, the probability it makes move m is entirely dependent on its own strategy. 

Now, suppose this is true for the first q — 1 rounds. In round q, the probability a cell makes 
move m is entirely dependent on its strategy, and the moves made by it and its r neighbors 
on each side, in preceding rounds of this generation. Therefore, by the induction hypothesis, 
this probability at the beginning of a generation is entirely dependent on the strategies of the 
(g — 2)r neighbors of these cells - cells c — {q — l)r through c+ {q — l)r. I 

We are thus left with the following model, in which, associated with each cell c, in each 
generation g, are: 

• A move/strategy variable mc,g from some finite alphabet S of A; characters. 

• A binary- valued life variable i^c,g- This variable can be set to either living, or not living. 

In each generation, cell strategies change, as follows: 
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• The probability that the hfe variable of a cell is set to 1, so that it "lives" into the next 
generation, is determined by a universal and unchanging game matrix G. That probability 
is based on the move/strategies of a cell and those of its r nearest neighbors on each side, 
in that generation. 

• A live cell keeps its strategy in the next generation. 

• A cell that does not live is given a new strategy in the next generation. This strategy is 
either that of its living nearest neighbor to the left, or to the right, with a 50% probability 
of each. If there are no living neighbors to either side, all possible strategies are equally 
likely. 

Note that, in this model, exactly two decisions are made in a generation; first, decisions 
about cell life or death; and second, decisions, for dead cells, of color in the next generation. 

This model lends itself easily to computer simulation, with the different strategies repre- 
sented by different colors. Thus, in descriptions of this model, "move," "strategy," and "color" 
are equivalent. Such a simulation is presented at the end of this paper, in Figure D.15. In this 
simulation, a cell has probability 0.27 of living if it is the same color as both of its neighbors 
and 0.53 otherwise. Due to the shapes of the space-time zones produced, this process is called 
the Cloud Process. The Cloud Process is an example of a join/mix cellular game, as discussed 



in Section 3.4 



We now discuss a theorem pertinent to this model; that is, a simple characterization of 
identity games. An identity game is a game in which, outside of certain pathological cases, no 
cell can change color. To avoid complications arising from these cases, the identity game is 
formally defined as follows: 

Definition 2.8 The identity game is a game in which, under at least some circumstances, 
cells have positive probability of living; and in which no cell can change strategy, unless there 
are no living cells either to the left or right of it. 

The characterization is: 

Theorem 2.9 Under the zero-depth model, a cellular game is the identity game if and only if 
the probability that a cell stays alive, if its strategy is different from at least one of its neighbors, 
is 1. 
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Proof. Suppose a G is a zero-depth cellular game of radius r, with life probabilities fitting 
the above description. Suppose a cell has living neighbors on each side. Then either: 

1. A cell is not the same color/strategy as both of its neighbors. Then it will stay alive. 

2. A cell c is the same color as both of its neighbors, but has neighbors on both sides of 
different colors, the nearest ones being cells c — ri on the left and c + r2 on the right. 
Then cells c — ri + 1 and c + r2 — 1 are alive. Therefore, if c dies, the left parent of c will 
be cell c — ri + 1, or a cell closer to c; and the right parent of c will be cell c + r2 — 1, or 
a cell closer to c. Thus if c dies, both parents will be the same color as c. 

On the other hand, suppose G is such that there is positive probability a cell ci of color a, 
next to a cell C2 of color b, may not live. Let there be a configuration of cells giving positive life 
probability to the center cell. Thus, since life probabilities are determined locally, it is possible 
that there may be living cells on either side of ci. Let ci die, and let it have living neighbors 
on each side. If either of these neighbors is not the same color as ci, then ci may change color; 
if both are, C2 will change color. I 

Finally, if cellular games, as described above, are intended to model living systems, two 
questions arise. First, why is a new strategy a symmetric function of the strategies of both 
parents, instead of, for example, being more influenced by the strategy of the nearest parent? 

One answer is that this process is intended to model sexual reproduction, in which a gene has 
an equal possibility of coming from each parent. Another is that if there is positive probability 
that each gene comes from each parent, the model may actually not behave very differently. 
Future research may settle this question. 

The second question is, why nonlocality? That is, why not say that if a cell has no living 
neighbors near enough, it just stays dead in the succeeding generation? In this case, comparison 
with living ecosystems does suggest that locality is more appropriate, but with a very large 
radius. That is, suppose there is a large die-off of organisms in one particular area. Then 
organisms from surrounding areas will rush in very fast, to fill the vacant area - but they 
cannot rush in infinitely far in one generation. Once again, future research may settle whether 
the simplified assumption, that is, nonlocality, actually creates different long-term behavior. 
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2.5 Ring and Torus Viability 

The following theorem describes move behavior which results in optimal cell viability, for a 
whole ring of cells. It applies to all cellular games with a local life probability matrix; that is, 
all games in which the probability a cell "lives" into the next generation is determined by its 
moves, and those of its neighbors less than a given number r of units away. It thus applies 
to the Arthur-Packard-Rogers model. However, it is here described in terms of the one-round 
model given in the previous chapter. 

Definition 2.10 The ring viability of a finite ring of cells C running a one-round game G, 
in generation g, is the average life probability of these cells in that generation after moves are 
made, but before the life variables of the cells are actually set. 

Since C has finitely many cells, whose moves are from a specific finite alphabet, there is 
some combination of moves which will maximize this viability. For example, in a one-round 
version of the Stag Hunt game, ring viability will be maximized if all cells cooperate; and, 
in some versions of the Prisoner's Dilemma, ring viability will be maximized if cells alternate 

between cooperation and defection. 

The result obtained is that this optimal arrangement is periodic. The following lemma is 
used in proving this: 

Lemma 2.11 Let G be a one-round cellular game of radius r, in which there are k possible 

moves from some finite alphabet S. Let t be any string in S*. Let L{t) be the average life 
probability of all cells in a ring of \t\ cells, such that the move of the ith cell is the ith character 
oft. Then, if b, wi, W2 are strings in T,*, \b\ > 2r, then we have 

L{hw,hw,) = ^(bw,) + L{bw,) ^2.1) 

Proof. Consider a ring of cells making consecutively the moves in bwibw2. Cells making 
moves from wi are more than r units away from cells making moves from W2. Therefore, these 
cells cannot influence each other's life probabilities. In the same way, b is large enough so the 
life probabilities of cells making moves in either copy of b can be influenced by cells making 
moves in wi, or in W2, but not by both. Therefore the average life probability of all cells is the 
same as if they were considered to be in two different rings. I 
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The main result follows: 

Theorem 2.12 Let G he a one-round cellular game as above. Then there is some m > and 
some sequence t of m moves, such that rings of nm cells, in which the moves of t are repeated 
n times, have the maximum ring viability, under G, for finite rings of any size. 

Proof. There are only a finite number of strings in S* that either contain no more than 4r 
letters, or, when circularly arranged, no duplicate, nonoverlapping 2r-tuples. Let such strings 
be called "good"; and let t be any "good" string that maximizes L{t). We wish to show that 



L(t)= max L(s) (2.2) 

because, then, rings repeating the moves of t one or more times would have maximal viability. 

Now, this is trivially true for s such that \s\ < 2r, because all such s are good. Suppose it 
is true for all s such that \s\ < n. We wish to show that it is true for s, such that \s\ = n. 

If s is good, this is trivially true. Suppose s is not good. Then we have s = wibw2b, \wi\, 



\w2\ > 0, |6| = 2r. Lemma |2.1l| shows that 



And, by our induction hypothesis, we know that L{wib) < L[t) and L{w2b) < L{t). I 
A corollary to this theorem is concerned with asymptotic viability of doubly infinite arrays 
of cells. 

Definition 2.13 Let l{c) be the life probability of a cell c, given its move and those of its r 
neighbors on each side. 



Definition 2.14 Let the asymptotic viability L[I), of a doubly infinite array of cells L, be 
measured as follows: 

L(/)=limsup^|^^ (2.4) 

Corollary 2.15 Let I be a doubly infinite array of cells. Then if t is that finite string that 
maximizes L(t), L{L) cannot be greater than L{t). 
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Proof. Consider what life probability cells n through —n would have if they were arranged 
in a ring, instead of part of a doubly infinite lattice. The only cells that might have different 
life probability are cells —n through —n + r — 1 and n through n — r + 1. And as n becomes 
larger, the contribution of these 2r cells to ring viability goes to 0. B 



In the two-dimensional case, however, a result similar to Theorem 2.12 is false. That is, 
there are two-dimensional cellular games, for which no finite torus can achieve maximal torus 
viability. This is not shown directly, but is a corollary of results about Wang tiles. 

A Wang tile is a square tile with a specific color on each side. A set of Wang tiles is a finite 
number of such tiles, along with rules for which colors can match. For example, a red edge may 
be put next to a blue edge, but not a white edge. Such a set is said to tile the plane, if the 
entire plane can be covered by copies of tiles in the set, so that all edge matchings follow the 
rules. Robert Berger 0] showed that there is a set of Wang tiles that can tile the plane, but 



permit no periodic tiling. Raphael Robinson [19| subsequently discovered another, smaller and 
simpler set of tiles that does the same thing. 

Note that the set of tiles described by Robinson admits an "almost periodic" tiling. That 
is, for any positive integer A^, the plane can be covered with these tiles periodically so that, 
under the given rules, the proportion of tiles having unmatching edges is less than jj. 

A two-dimensional cellular game can be made from a k- colored set of Wang tiles as follows: 
Let a cell be considered a tile; let there be possible moves, and let these moves be considered 
direct products of the colors of the Wang tiles. Let the life probability of a cell be increased 
by I for every match of a component of its move, with the corresponding component of the 
move of its neighbor. For example, | would be added to the life probability of a cell, if the left 
component of its move were compatible to the right component of the move of its left neighbor. 

Suppose a cellular game were made, in this manner, from the set of tiles described by 
Robinson. Then no torus could have viability one, because otherwise there would be a periodic 
tiling of the plane using these tiles. However, there are periodic tilings of the plane for which 
only an arbitrarily small proportion of the tiles have unmatching edges. Therefore, since a 
periodic tiling of the plane can be considered a tiling of a torus, there are torus tilings having 
viability 1 — e, for any e > 0. 

The comparison of cellular games and Wang tilings suggests other possibilities for future 
research on tilings. For example, instead of a Wang tiling in which two colors either match or 
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not, one could consider a tiling in which two colors can partially match. This would correspond 
to a cellular game in which more than two different levels of success were possible. 

2.6 Strategy Stability 

In the preceding chapter, the concept of ring viability was discussed. That is, for each cellular 
game, there is some periodic combination of moves which maximizes average cell viability. One 
might assume that all cellular games would stabilize with cells exhibiting, or mostly exhibiting, 
such a combination of moves. If this assumption were true, questions about the long-term 
evolution of cellular games could be trivially resolved. 

However, computer experiments suggest that this is not necessarily the case. That is, a 
one-round cellular game is simulated in which each cell plays the Prisoner's Dilemma with each 
of its neighbors. Specifications are: 

• Radius. The game is of radius one. 

• Strategies. There are two strategies, or colors: "C," cooperate, or white, and "D," defect, 
or black. 

• Game Tabie. The game life probability table is: G{CDC) = 1, G{CDD) = G{DDC) = 
^, G{CCC) = ^, G{DDD) = ^, G{GCD) = G{DCC) = ^, G{DCD) = 0. 

{G{mim2mz) is the probability of a cell surviving, if the move of its right neighbor is mi, 
its own move is 7712, and the move of its left neighbor is ma.) 

Under these circumstances, maximal ring viability is achieved by a ring of all-cooperating 
cells. And yet, computer experiments simulating this game do not show the mostly cooperative 
state to be stable. In the simulation depicted in Figure D.16, a small number of defecting cells 
are put in the middle of a large ring of cooper ators. The defecting strategy quickly takes over 
the ring. 

The reason for this is that, although defectors do badly against each other, they do extremely 
well against cooperators. Thus, if a small zone of defecting cells is placed in a large ring of 
cooperating cells, the area between the leftmost and rightmost defecting cells tends to expand. 

To address such questions more formally, we use the concept of a domain: 
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Definition 2.16 A domain is a contiguous row of same-colored cells. 

We would like to examine what happens when a small defecting domain is placed between 
two very large cooperating domains. Is the number of defecting cells in the vicinity of that 
domain likely to go up, or down? If it is more likely to go up, we can reasonably say that 
cooperative behavior is not stable under invasion. 

Of course, conceivably, each strategy could be unstable under invasion by the other; that 
is, there could be a tendency for large domains of each color to break up into smaller ones. 

Let there be a doubly infinite lattice of cells, running the Prisoner's Dilemma game described 
above. Let -B be a small, but greater than one-cell, black domain in this lattice, bordered, in 
generation 1, by two large white domains Wi and Wr- Let \B\ be the number of black cells 
in B in generation 0. Let SB equal the number of cells that were white in generation 1, and, 
in generation 2, have black strategies descended from the strategies of cells in B - minus the 
number of cells that were in B in generation 1, and are white in generation 1. Thus, SB is, 
roughly, the change in the number of black cells in the vicinity of B in the next generation. 
Finally, let ci be the rightmost member of Wi, C2 the leftmost member of B, the rightmost 
member of B, and C4 the leftmost member of Wr, in generation 1. 

Now, two terms used in the theorems presented in this chapter are defined. 

Definition 2.17 Let a black incursion be a situation in which a black cell c, in D, becomes 
in the next generation the parent of newly black cells in Wi or Wr- If it becomes the parent of 
cells in both, let it be regarded as two incursions. 

Definition 2.18 Let the cell c, the parent of the newly black cells in the incursion, be called 
the parent of the incursion. 

Definition 2.19 Let a white incursion, and its parent, be defined in a similar manner; that 
is, a situation in which a white cell becomes the parent of cells formerly in B. 

Definition 2.20 Let a black incursion possibility be a situation in which an incursion into 
Wi is possible, because ci has died, or a situation in which an incursion into Wr is possible, 
because C4 has died. Similarly, let a white incursion possibility be a situation in which an 
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incursion into B with parent in Wi is possible, because 02 has died, or an incursion into B with 
parent in Wr is possible, because C3 has died. 

We now show that as the size of the bordering white domain becomes arbitrarily large, the 
expected size of a black incursion into that domain (if possible, as explained above), should 
approach |. 

Lemma 2.21 Let be the expected size of a black incursion into a white domain W, given 
that there is a black incursion possibility with parent in B, and that \W\ = n. Then, under G 

hm En = \ (2.5) 

Proof. Suppose the nearest cell w, in W, to B to stay alive is such that there are k dead 
cells in W between w and B. Then cells in W between w and B have parents of both colors, 
and their probability of becoming black is thus 5 . Now, the probability of there being k such 
cells to die, under G, given the incursion possibility, is G{CCC){1 - G{CCC))''-'^ = f (|)'^"^ 
That is, each white cell with two white neighbors has probability G{CCC) = | of living. Thus 



hm En = hm yd)d)df-^ = yd)(±)(if-^ = ^ (2.6) 

k=l k=l 



We also bound the expected size of a white incursion. 

Lemma 2.22 Let E^ be the expected size, under G of a white incursion into B from a white 
domain W, given that there is a white incursion possibility with parent in W, and that \B\ = m. 
Then Em < f. 

Proof. Suppose the nearest cell b, in S to to stay alive is located so that there are k 
dead cells in B between b and B. Then cells in B between b and W have parents of both colors, 
and their probability of becoming white is thus ^ . Now, the probability of there being k such 
cells to die, under G, given the incursion possibility, is G{DDD){1 - G{DDD))^~^ = |(|)''~^. 
(Since each black cell with two black neighbors has probability | of living.) Thus 

Em = t{\)(^)(^f-' < f:^)i^)^f-' = I (2.7) 
fe=i fe=i 
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The main theorem follows: 

Theorem 2.23 Let B be a small black domain on a doubly infinite lattice, on which the Pris- 
oner's Dilemma game G is run. Let all variables be as described above. Then, if \B\ > 2, and 
Wi and Wr are large enough, the expected value of 6B, which is roughly the expected change in 
the number of black cells in the vicinity of W, is positive. 

Proof. We examine eight cases, depending on the life of ci, C2, C3, and C4. Note that ci 
and C4 have probability G{CCD) = G{DCC) = ^ of living; and C2 and C4, have probability 
GiCDD) = G{DDC) = ^. 

1. All four cells live. Then 5B = 0. 

2. ci, C2, C3 live, C4 does not (or the reflection of this case). The probability of this is 
2(^)(^)^. There is one black incursion possibility (with C3 as the parent), of expected 
size that approaches |, as the neighboring domain becomes arbitrarily large. 

3. ci, C2 live, C3 dies, C4 lives (or the reflection). The probability of this is 2(^)(]^)(^)^. 
There is one white incursion possibility (with C4 as the parent), of expected size < |. 

4. ci, C2 live, C3, C4 die (or the reflection). The probability of this is2(^)(^)(T^)(^). There 
is one black incursion possibility (with C2 or a cell between C2 and C3 as the parent), of 
expected asymptotic size |; and there may be one white incursion possibility (with a cell 
to the right of C4 as the parent), of expected size < |. 

7 4 

5. ci dies, C2 lives, C3 lives, C4 dies. This case has probability ^ . There are two black 
incursion possibilities (with C2 and C3 as the parents), of expected asymptotic size | each. 

6. ci dies, C2 lives, C3 dies, C4 lives (or the reflection). The probability of this is 2(^)^(^)^. 
There is one black incursion possibility (with parent C2), of expected asymptotic size |; 
and one white incursion possibility (with parent C4), of expected size < |. 

7. ci dies, C2 lives, C3 and C4 die (or the reflection). The probability of this is 2(]^)^(^)(]^). 
There is one black incursion possibility (with parent C2), of asymptotic size |; and there 
may be one white incursion possibility (with parent to the right of C4), of expected size 
< ^ 
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8. C2 and C3 both die. The probabihty of this is ^ . There may not be a black incursion, if 
every cell in D dies. There are at most two white incursion possibilities of expected size 
< I each. 

Thus, if |S| > 2, and Wi and Wr are large enough, under all cases the expected value of 5B 
must exceed 2(A)(^)3(|) - 2(^)(A)3(|) + 2(X)2(^)2(5 _ 5^ + (^)42(5) + 2(^)2(A)2(5 _ 

I) + 2(i^m)(i-!)-(^)^2(f ) = 

However, it is not always the case that, in a two-strategy system, the "dominant" strategy 
will prevail. One strategy may lose against another, but do so well against itself that its use tends 
to expand. This happens in zero-depth versions of the previously discussed Stag Hunt, a game 
similar to the Prisoner's Dilemma, except that successful cooperation is more profitable than 
exploitation. If computer experiments (Figure D.17) simulate this game, giving a high enough 
premium for mutual cooperation, then cooperative behavior does tend to prevail. Specifically, 
the game has the same radius and number of moves as the Prisoner's Dilemma game described 
above. Its table is: G{CDC) = G{CDD) = G{DDC) = ^, G{CCC) = 1, G{DDD) = ^, 
G{CCD) = G{DCC) = ^, G{DCD) = 0. 

It is possible, using the same techniques as above, to show that black domains are unstable 
in this game. 

Theorem 2.24 Let W he a small white domain on a doubly infinite lattice, on which the Stag 
Hunt game as described above is run. Let Bi and he its neighbors, and \W\ its size in 
generation 1. Let SW equal the number of cells that were black in generation 0, and which 
in generation 1, have white strategies descended from the strategies of cells in W - minus the 
number of cells that were in W in generation 1, and are black in generation 2. Then, if\W\ > 2, 
and Bi and Bj. are large enough, the expected value of 6W, roughly the expected change in the 
number of white cells in the vicinity of W, is positive. 

Proof. The same calculations as described above are carried out, except that white and 
black are exchanged, and the probabilities of the Stag Hunt game are used. The asymptotic 
expected size of a white incursion, given the possibility of such, turns out to be 2. The expected 

size of a black incursion, given the possibility of such, turns out to be less than or equal to ^ 
(since cells that are white and bordered on both sides by white neighbors cannot die). The 
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asymptotic expected change in the number of white cells in the vicinity of W turns out to 
exceed |||. I 

Nash equilibria of cellular games have also been analyzed Q. 

Definition 2.25 In a cellular game context, a symmetric Nash equilibrium (SNE) arises 
if, when the r nearest neighbors of a cell on each side use strategy s, its best response is also to 
use s. 

For example, in the Stag Hunt game described above, both unilateral cooperation and 
defection give rise to such equilibria. That is, if the neighbors of a cell always cooperate 
(defect), a cell is best off cooperating (defecting) too. 

As with ring viability, it is easy to assume that Nash equilibria determine the course of 
a game; that is, that a strategy giving rise to a symmetric Nash equilibrium is stable under 
invasion by other strategies. However, while the study of Nash equilibria is a promising avenue 
to understanding cellular games, such an automatic assumption is not necessarily the case. For 
example, in the Stag Hunt, unilateral cooperation gives rise to a SNE. However, in some versions 
of this game, cooperating domains are unstable. This is because though isolated defecting cells 
don't survive well, they are likely to kill off their neighbors. Thus, they tend to have more 
descendants than their neighbors. 

The parameters used in this version of the Stag Hunt are not exactly the same as above. 
They are: G{CDC) = if, G{CDD) = G(DDC) = if, G{CCC) = 1, G{DDD) = i|, G{GGD) 
= G{DCC) = ^, G{DGD) = 0. 

Computer experiments simulating this process (Figure D.18) do indeed suggest that white 
domains are unstable. This result can also be proved using the same techniques as above. 

Theorem 2.26 Let B be a small black domain on a doubly infinite lattice, on which the second 
Stag Hunt game as described above is run. Let Wi and Wr be its neighbors, and \B\ its size 
in generation 1. Let 5B equal the number of cells that were white in generation 1, and, in 
generation 2, have black strategies descended from the strategies of cells in B - minus the 
number of cells that were in B in generation 1, and are white in generation 2. Then, if \B\ > 2, 
and Wi and Wr are large enough, the expected value of 5B, roughly the expected change in the 
number of black cells in the vicinity of B, is positive. 
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Proof. The same calculations as described for the Prisoner's Dilemma case are carried out, 
except that the probabihties of the second Stag Hunt game are used. The asymptotic expected 
size of a black incursion, given the possibility of such, turns out to be ^, since cells that are 
white and bordered on both sides by white neighbors cannot die. The expected size of a white 
incursion, given the possibility of such, turns out to be less than or equal to . The asymptotic 
expected change in the number of black cells in the vicinity of B turns out to exceed i 

Thus, we see that cellular game behavior is difficult to anticipate. These systems reflect the 
richness of living ecologies, in which a species' survival is determined by how well the organisms 
of that species compete with others, how well they cooperate among themselves, and how many 
descendants they have. No one factor automatically decides the issue. 
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Chapter 3 



Two Symmetric Strategies 

3.1 Introduction and Definitions 

Under the zero-depth model described previously, the simplest case to examine is that of games 
with only two possible strategies. Let these strategies be called black and white; and let a cell 
using a black (white) strategy be called a black (white) cell. We thus have the following model. 
Associated with each cell, in each generation, are: 

• A binary- valued move/strategy variable. 

• A binary-valued life variable. This variable can be set to either living, or not living. 

In each generation, cell strategies change, as follows: 

• The probability that the life variable of a cell is set to 1, so that it "lives" into the next 
generation, is determined by a universal and unchanging game matrix G. That probability 
is based on the move/strategies of a cell, and those of its r nearest neighbors on each side, 
in that generation. 

• A live cell keeps its strategy in the next generation. 

• A cell that does not live is given a new strategy for the next generation. This strategy is 
either that of its living nearest neighbor to the left, or to the right, with a 50% probability 
of each. If there are no living neighbors to either side, all possible strategies are equally 
likely. 
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We wish to understand the long-term behavior of such processes. For simphcity, we first 
consider systems with infinitely many cells. And, to understand their behavior in general, it is 
illuminating to first consider their behavior in the following case, in which the possible future 
courses of evolution are countable. 

Definition 3.1 Initial conditions in which there are finitely many black cells are ca/Zed finitely 
describable initial conditions. 

Note that if there are initially only finitely many black cells, there will always be only finitely 
many black cells. Therefore, it is more appropriate to speak about a game evolving under such 
conditions, than from such conditions. 

The following definitions are also used: 

A domain (Definition p. 16 is a contiguous row of same-colored cells. 



Definition 3.2 Under finitely describable initial conditions, let the zone of uncertainty start 
with the leftmost black cell and end with the rightmost one. If there are no black cells, there is 
no such zone. 

Now, suppose each cell had probability 1 of staying alive, no matter what. Then all dynamics 
would be trivial; the system could never change. We would like to avoid such situations; that is, 
we would like to assure that change is always possible. We would also like to assure that, under 
initial conditions as described above, the two domains on either side of the zone of uncertainty 
will, almost always, contain infinitely many living cells. Both ends are achieved by specifying 
that each cell always has positive probability of either living or not living. 

Definition 3.3 Let a cellular game as described above; that is, zero depth, with two strategies, 
and the above restrictions on life probabilities, be called a simple cellular game. 

Now, the main problem associated with any stochastic process is to figure out how it behaves 
in the long run; not only to figure out how it may behave, but how it must behave. 

In this chapter, we settle this question, at least partially, for certain classes of games. 
That is, we consider simple cellular games with left /right symmetry, evolving under finitely 
describable initial conditions. We show that for such games, the probability that the zone of 
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uncertainty will grow arbitrarily far in one direction only is zero. It must, with probability 1, 
either disappear, or grow forever in both directions. 

How is this proved? First, we use Theorem p.4| , presented below, a result which applies both 
to cellular games and other stochastic processes. This theorem implies that if a simple cellular 
game evolves as above, and if, under any conditions, the probability this zone will "glide" 
arbitrarily far to the left is positive, there are initial conditions under which this probability 
can be made as high as desired; that is, greater than 1 — e, for any e > 0. 

Then, we show that under such initial conditions /e, with very high probability of the zone of 
uncertainty "gliding" off in one direction, there would have to be probability greater than some 
constant that another glider will spin off and shoot out in the other direction. This constant 
would not depend on the initial conditions, but only on the game. This part of the proof is 
accomplished in the following manner: 

First, without loss of generality, we locate 1^ so that the rightmost black cell is cell 0. 

Then, we count cases in which the zone of uncertainty "glides" arbitrarily far in one direction 
only. We need to count cases in such a way that no case is counted twice. To do this elegantly, 
we restrict our attention to particular cases in which this zone moves to the right in a certain 
way; that is, those cases in which, just before this zone moves past cell for the last time, there 
is exactly one nonnegative black cell, at position r or greater. 

In a lemma, it is shown that under any I^, with e small enough, the probability that the 
"glider" will operate in such a way is more than some fixed proportion 7 of the probability 
that a glider will operate at all. This 7 is dependent on the game only, and not on the initial 
conditions. Thus, the sum of all such cases must be greater than 7(1 — e). 

For each such case, we show there is another case with probability only a fixed proportion 
less, in which another glider goes off in the other direction. To do this, we use the fact that 
what happens at the end of the zone of uncertainty; that is, to some specific, fixed number of 
cells, cannot change the probability of a one-generation history very much. 

Thus, we can put a lower bound f3 to the probability that in generation g, the game behaves 
exactly as in the case counted above, except that a two, three or four-cell black domain D is 
spun off, at a distance from all other black cells greater than the radius of the game. 
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We can show that if there is any positive probabihty of a ghder moving in one direction, 
there is positive probabihty at least a that, if the zone of uncertainty contains only a domain 
hke D: 



1. This zone will act like a glider, moving arbitrarily far to the right. 

2. This zone will, in every generation, contain more than one black cell. 

Note that this a will also apply if the positive cells are as above, and the negative black 
cells D itself acts as a glider, moving to the right and staying from that point on in the positive 
area, and that this glider from that point on continues to contain two or more cells. Since 
the negative black cells are themselves acting as a glider, it can be shown that they will not 
interfere with the behavior of cells in the positive area. It is in this part of the proof that the 
left/right symmetry comes in; it is used to show that gliders can move in both directions. 

Since this right-traveling glider continues to contain two or more cells, we are able again to 
avoid counting cases twice. That is, each case is assigned to the last generation in which there 
is exactly one nonnegative black cell. 

Thus, the probability that the domain between the two gliders will grow arbitrarily large, 
and the zone of uncertainty will continue to expand forever in both directions, can be given a 
lower bound. It can be shown, for small enough e, to be greater than 7/3a(l — e), with these 
constants depending only on G. If e is small enough, this forces a contradiction. In reference 
to these two gliders, this main theorem. Theorem p. 14 , is called the Double Glider Theorem. 



Another kind of initial condition is also discussed; that is, initial conditions under which 
there is a leftmost white cell and a rightmost black cell. A conjecture is presented which applies 
to such conditions. 

Processes that are symmetric black/white, as well as right/left, are discussed. They are 
separated into two categories, mixing processes and clumping processes. This separation is 
based on their behavior under standard restricted initial conditions. The properties of clumping 
processes are further examined. In this context, a theorem is used which can be applied to 
symmetric random walks in general. 

Finally, computer experiments are presented. These models simulate the evolution of simple 
cellular games, with both kinds of symmetry, on a circular lattice. It is shown how this evolution 
varies as parameters vary. 
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The following theorem applies to all discrete-time Markov chains. It can be used to charac- 
terize cellular game evolution under finitely describable initial conditions. 

Theorem 3.4 Let M = {X{t),t E 0,1,2,...} he a discrete-time Markov chain. Let a finite 
history he a list of possihle values for X{i), < i < n, for some < n < oo. Let H he any 
collection of infinite histories, which can he expressed as a countable Boolean combination of 
finite histories. Furthermore, let no finite part of any history in H determine membership in 
H . Let the probability of H , under any initial conditions X{0) = x, he positive. Then, for any 
e > 0, there are initial conditions L^ such that there is probability 1 — e the infinite history of 
this process (that is, the values of X{0),X(1), . . . , X{n), . . .) will he in H . 

Proof. Let all possible finite histories of M, given -'^(O) = x, be placed in correspondence 
with open intervals in (0, 1) as follows: 

1. IfPxi > 0, let the event that X{1) = i correspond to the open interval {J2j<i Pxj, J2j<i Pxj + 

Pxi)- 

2. Suppose X{n) = s in generation n, n > 1. Let the interval (a, h) correspond to the values 
of ^(0) . . . X{n). Then, if Pgi > 0, let the event that X(n + 1) = i in this generation 
correspond to the open interval (a -|- J2j<i Psj{b — a),a + J2j<i Psj + Psiib — a)). 

Similarly, let countable Boolean combinations of finite histories correspond to countable 
Boolean combinations of history intervals. Note that under this relationship, the probability of 
any finite history equals the length of the interval; and the probability of any countable boolean 
combination of finite histories H equals the Lesbegue measure of the corresponding measurable 
subset of (0, 1). Thus, if IL has positive probability, it corresponds to a real subset S of (0,1) 
of positive measure. 

By a theorem of real analysis 
contained in (0, 1) such that 

^.^M^n(p-.,p + e))^^ (3.1) 
e^o 2e ^ ' 

By the construction, there is a history interval contained in every interval on the unit line. 

Hence, for every e > 0, there is a history interval I, corresponding to a finite n-step history h 



21], if 5 n (0, 1) has positive measure, there is some point p 
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in which X[n) = s, such that ' > 1 — e. By the construction, then, the probabihty that 
the future history of M will be in H, given h, exceeds 1 — e. By the Markov property of M, 
and the fact that the finite history h does not determine membership in H, the probability of 
this, given ^(0) = s, must also exceed 1 — e. B 

Note that for this theorem to apply, H must be such that no finite history determines 
membership in H. For example, H cannot be all histories such that ^(2) = 1. On the other 
hand, H could be all histories such that X{n) = 1 for infinitely many n. 

Corollary 3.5 Let G he any simple cellular game. Let it evolve under finitely describable 
initial conditions. Let H be any countable Boolean combination of finite game histories. Let 
the probability of H, under any initial conditions, be positive. Then, for any e > 0, there are 
finite initial conditions such that there is probability 1 — e the infinite history of this game will 
be in H. 

Proof. Let the state X{g) of G in generation ^ be a list of black cells at the beginning of that 
generation. Thus, the states of G can be matched with the positive integers. The evolution of 
G can be considered a Markov chain, since the probability of entering any state is dependent 
on conditions in the previous generation only. I 

3.2 The Double Glider Theorem 

The Double Glider Theorem applies to all simple cellular games with left /right symmetry. It 
shows that if such a game evolves under finitely describable initial conditions, the probability 
that the zone of uncertainty will expand arbitrarily far in one direction only is zero. That is, 
the zone of uncertainty cannot "glide" forever to the left, or right. It is shown that if such a 
glider could evolve, as it progressed it could throw off a reflected glider, moving in the opposite 
direction; and that if both such actions had positive probability, there would be a contradiction. 
A new definition is used in the implementation of this proof. 

Definition 3.6 Let the effective zone of uncertainty consist, in each generation, of cells 
in the following categories: 

1. Cells in the zone of uncertainty. 
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2. Cells beyond the zone of uncertainty that have a black cell as one of their nearest living 
neighbors. 

That is, cells beyond the zone of uncertainty that can become either black or white are also 
in this zone. The extent of this zone in generation g is dependent not only on cell colors at the 
beginning of that generation, but on life/death decisions made during that generation. 

Thus, the evolution of a simple cellular game, under finite initial conditions, can be con- 
sidered to occur in each generation as follows: First, life/death decisions are made about cells 
within the zone of uncertainty. Then, if the leftmost living cell in the zone of uncertainty is 
black, life/death decisions are made about cells to the left of this zone. These decisions start 
with the cell on its border, and proceed left until one lives. Then, if the rightmost living cell in 
the zone of uncertainty is black, decisions are made in the same way about cells to the right of 
this zone. Finally, black/white decisions are made. There are no other decisions that can affect 
the course of this game. 

The concept of effective zone of uncertainty can be extended to apply to cells on each side 
of a domain. 

Definition 3.7 Let the left effective zone of uncertainty D/ of a white domain D consist 
of: 

1. Those cells in the effective zone of uncertainty to the left of D. 

2. Those dead cells in D whose nearest living neighbor to the left is black (and thus to the 
left of D). 

Let the right effective zone of uncertainty Dj. he defined similarly. 

Thus, cells that are in D, and not in either Di or D^, must stay white. We now show that 
if these two effective zones stay separated far enough, they cannot affect each other. 

Theorem 3.8 Let G he a simple cellular game of radius r, operating under finite initial condi- 
tions. Let D he a white domain under G. In generation g, let D include at least cells through 
r. Furthermore, let all cells in Di be to the left of cell and all cells in be to the right of 
cell r. Then the life/death probability of any cell in Di (D^.) will not have been influenced by 



38 



that of any cell in Dj. (Di). Also, black/white decisions for all cells in Di (Dr) will be exactly 
the same as if Dr (Di) did not exist; that is, if Di (Dj.) comprised the entire effective zone of 
uncertainty. 

Proof. The first statement is true because \D\ > r+1. The second statement is true because 
if the effective zone is as thus stated, each cell in Di (Dr) must have at least one parent in Di 
{Dr), and no dead cell can have parents from both Di and Dr unless both parents are white. I 

The following lemmas characterize the expansion of the zone of uncertainty. 

Lemma 3.9 Let G be a simple cellular game with left/right symmetry. Let R{g) be the position 
of the right border of the zone of uncertainty in generation g, if it exists. Let ai be the smallest 
probability that any cell stays alive, and the largest. Then, for any n, there is always 
probability at least |(ai)^(l— 02)""^^ that R{g+2)—R{g) > n; and probability at least ^"^^af (1— 
0:2)"+^ that Rig) - R{g + 2) > n. 

Proof. Without loss of generality, assume R{g) = 0; that is, assume that cell is black 
and there are no black cells to the right of it. Thus, there is probability at least ai{l — 0:2)""''^ 
that, in generation g, cell lives, and all cells between it and cell n + 2 do not. Given these 
events, there is probability at least | that cell n + 1 becomes black in that generation. Given 
these events, in generation g + 1 there is probability at least ai that cell n + 1 lives, thus 
staying black into the next generation. Thus there is probability at least ^(ai)^(l — a2)"'~^^ 
that R{g + 2) - R{g) > n. 

Now, suppose cell — n — 2 is black. Then there is probability at least (q;i)^(1 — 0:2)""'"^ that, 
in generation g, cell 1, which is white, lives, cell — n — 2 lives, and all cells between those two do 

1 n+2 

not. Given these events, there is probability ^ that cells through — n become white, and 
cell —n — 1 black, in that generation. Given these events, in generation g + 1 there is probability 
at least (ai)^ that cells —n and —n — 1 both live. This will ensure that at the beginning of 
generation g + 2, the zone of uncertainty will still exist and have the desired border. 

On the other hand, suppose cell —n — 2 is white. Then there is probability at least af (1 — 
0:2)""*"^ that, in generation g, cell 0, which is black, lives, cell n — 2 lives, and all cells between 
these two do not. Given these events, there is probability ^"^^ that cell —n — 1 becomes black, 
and cells — n through —1 become white in that generation. Given these events, in generation 
g + 1 there is probability at least af (1 — 02) that cells —n — 1 and — n live and cell dies. As 
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before, this will ensure that at the beginning of generation g + 2, the zone of uncertainty will 
still exist and have the desired border. Thus, there is probability at least ^^~^'^af{l — 02)"''^'^ 
that R{g) - R{g + 2) > n. ■ 

Similar results, of course, apply to L{g). 

Lemma 3.10 Suppose the zone of uncertainty moves arbitrarily far to the left only. Then the 
probability that its right border will not recede arbitrarily far to the left (that is, that it will stay 
within some bounded interval) is 0. Furthermore, the probability that the right effective border 
will not also recede arbitrarily far to the left is 0. 

Proof. Let qi be the smallest probability that any cell stays alive, and 02 the largest. Let 
R{g) be as above. By Lemma p.9| , if —k < R{g) < k there is probability at least ^(ai)^(l — 
^2^fc+n+i ^j^^^ + 2) > n. Thus, if -k < R{g) < k for infinitely many g, then R{g) will 
almost always, infinitely many times, be greater than any n. 

Let R'{g) be the position of the right border of the effective zone of uncertainty in generation 
G. (Again, let R'{g) be defined only if this zone exists.) Each time R'{g) > —k, either 
^(9) > oi' cell —k has 50% probability of becoming black. If this cell does become black, 
R{g + 1) will exceed —k. Thus if R'{g) exceeds —k infinitely many times, R{g) will, with 
probability 1, exceed —k infinitely many times too. I 

As above, similar results, apply to the left border of the zone of uncertainty. 

Some concepts are now presented for subsequent use. 

Let a cell history for generations g up to h consist of: 

1. The system state (that is, the positions of all black cells) at the beginning of generation 
9- 

2. All meaningful life decisions made in generations g through h — 1; that is, all life decisions 
made within the zone of uncertainty, and for those cells outside it whose nearest living 
neighbor on one side is black. 

3. All color decisions made where color is in doubt; that is, for cells that die and have nearest 
living neighbors of different colors on each side. 
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Let H{g, h) refer to a cell history as described above. Note that this description only refers 
to life decisions made within the effective zone of uncertainty. Thus, the probability of any 
history is affected only by such decisions. 

Let the following function be defined for any cell history h = H{1, g) that starts at generation 
1. Let Fi{h) = 1 if, under /i, in generation g there is exactly one nonnegative black cell, at 
position r or greater. Let Fi{h) = otherwise. 

Similarly, let F2 and F3 be defined for one-generation cell histories h = h{g,g + 1). Let 
F2{h) = 1, if in generation g there exactly one nonnegative black cell, in position r or greater 
(that is, if Fi would be 1 for the previous history), and, under h, in generation g + 1 there are 
none; and let F2{h) = otherwise. Let Fs{h) = 1 if in generation ^ + 1 there are two, three or 
four black nonnegative cells, both next to each other, and both in positions r or greater. Let 
F^(h) = otherwise. 

The following lemmas arc used in constructing the main proof. The next two lemmas, 
which compare the probabilities of different 1-generation cell histories, both use the same idea: 
Changing what happens to only a specific number of cells is likely to have only a limited effect 
on the probability of the history. 

Lemma 3.11 Let G be a simple cellular game. Then for each 1-generation history h such that 
F2{h) = 1, there is a different 1-generation history h' such that all the following apply. 



2. h and h' both start with the same system states. 

3. At the end of generation g, given history h' , the negative black cells are exactly the same 
as those at the end of g given h. 

4. For any history (starting at generation 1) Hq, we have 



1. Fsih') = 1. 



P{H{g,g + 1) = h'\H{l,g) = h^) > 



(3.2) 



(3P{H{g,g + l)=h\H{l,g)=ho) 



(3.3) 



with (3 depending only on g. 



41 



Proof. Let h he a, cell history such that F2{h) = 1. That is, at the beginning of the 
generation g in which h occurs, there is one nonnegative black cell c. Under h, c must die, 
because in generation g + 1 there will no longer be any more nonnegative black cells. Let b be 
the nearest cell to c, on the left, that stays alive in generation g. 

Let ai be the smallest probability that any cell stays alive, and 02 the largest. By the 
definition of a simple cellular game, both these numbers must be greater than 0. Let as be the 
minimum of cti, a2, 1 — cci, 1 — a2- 

Case L b is black (and thus in a negative-numbered position) . Let cell d be the closest living 
neighbor of cell c on the right. Let it die as before, and let cell d+1 die. As under h, all dead 
cells between b and d have a 50% chance of becoming black. Let their colors be assigned the 
same; e.g., cells through d—1 will become white. Let cells d and d + 1 become black. Let all 
other life/death and black/white decisions be as under h. 

Thus, this new history h' satisfies F^{h') = 1, it produces the same negative black cells as 
h, and we have 



P{H{g,g + l) = h'\H{l,g)=ho)> (3.4) 
^^P{H{g,g + 1) = h\H{l,g) = ho) (3.5) 

Also, h can be reconstructed if h' is known; that is: 
L Initial conditions are the same for both histories. 

2. Under h', the location of cells d and d + 1 are known; they are the only nonnegative black 
cells in generation g + 1. 

3. All life/death and color decisions in the effective zone of uncertainty are the same, except 
for cells d and d + 1. 

4. The history of cell d, under h, is exactly known. It stays alive and stays white. 

5. The life or death of cell d+1, under h, is not known. However, under h, this cell is not 
in the effective zone of uncertainty and decisions about it are not considered part of the 
cell history. 
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Thus, in this case, for each different h there is a different h' satisfying the conditions of this 
lemma. 

Case II: Cell b is white, and one cell to the left of c. Under h', let cells c and c + 3 live. 
Let cells c + 1 and c + 2 die. Since c is their right parent, they can become black in the next 
generation; let them do so. 

Let all other cells live or die, and change color, as under h. Note that cell c cannot become 
a parent of cells to the left, since it is bordered on the left by the living cell b. 

Thus, Fs{h') will be 1, it will produce the same negative black cells as h, and we have 



P{H{g,g + l)=h'\H{l,g)=ho)> (3.6) 
^-^P{Hi9,9 + 1) = h\H{l,g) = ho) (3.7) 

A history h' constructed in this manner cannot be confused with one created using the first 
method, since at the end there are three nonnegative cells rather than two. Its uniqueness can 
be shown by methods similar to those used in the first case. 

Case III: Cell b is white and more than one cell to the left of c. Let cells c — 1 and c live; 
let cells c + 1 through c + 3 die, and let cell c + 4 live. Let all other cells live or die as under h. 

Now, cell c — 1 must be white, since cell c is isolated. Therefore, cells 6+1 through c — 2 
must, as under h, become white. Let cells c + 1 through c + 3 become black. Note that all other 
cells have the same color options as under h. 

Thus, Fs{h') will be 1, it will produce the same negative black cells as h, and we have 



PiH{g,g + l) = h'\Hil,g)=ho)> (3.8) 
^P{H{g,g + 1) = h\H{l,g) = ho) (3.9) 

This h' cannot be confused with one created using the first two methods, since at the end 
there are four nonnegative cells rather than three or two. Its further uniqueness can also be 
shown by methods similar to those used in the first case. Therefore, the conditions of the 
theorem are satisfied for all three cases, with (3 = -^^f^. I 

Now, if there is positive probability of a glider - that is, of the effective zone of uncertainty 
moving arbitrarily far in one direction only - then there is positive probability that in some 
generation g, this zone will leave the nonnegative area for the last time. 
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The following lemma characterizes, for certain initial conditions, how this can happen. For 
these conditions, we put a minimum bound on the probability that, in the generation this zone 
leaves the nonnegative area, there is exactly one black cell - and this cell is at position r or 
greater. This bound depends only on G. 

The ways this zone can leave the nonnegative area are divided into four cases. (Actually, 
three main cases; the last two are quite similar.) For each of these cases, a different construc- 
tion is used to accomplish the proof. As in the preceding lemma, each of these constructions 
uses histories that behave similarly to the ones under consideration, and hence have similar 
probabilities of occurrence. 

Lemma 3.12 Let G he a simple cellular game of radius r, operating under finite initial condi- 
tions I. Let ai he the lowest prohahility, under G, that any cell stays alive. Let there he positive 
prohahility that under I the effective zone of uncertainty moves arbitrarily far to the left; that 
is, that some generation g is the last in which the effective zone of uncertainty contains non- 
negative cells. Let Zg = 1 if this is true for generation g, and otherwise. Let P{3g, Zg = 1) 
exceed 1 — Let Xg = 1 if Zg = 1, and at the beginning of g there is only one nonnegative 
black cell, at position r or greater, and otherwise. Then, for some 7 depending only on G 

P{3g, Xg = l)> jP{3g, Zg = 1) (3.10) 

Proof. Let 02 be the highest probability, under G, that any cell stays alive. (By definition, 
ai, a2 > 0.) Let as, again, be the minimum of ai, 02, 1 — ai and 1 — 0:2. Let be the life 
probablity of a black cell whose r neighbors on each side are also black. Let Cg be the rightmost 
living cell in the zone of uncertainty, in generation g. Let Dg be the rightmost black domain in 
that zone, and let eg be the white cell at its left border. 

First of all, we know that there is probability at least ai that in generation 1, the leftmost 
black cell lives. Therefore, there is probability at least ai that Zi = 0. Thus, if P(^g, Zg = 
l)>l-^,we know that P{3g,g >2,Zg = l)>^. 

Now, suppose there exists a generation g > 1 such that Zg = 1. The conditions under which 
that occurs can be divided into four cases, as follows: 

1. Cg, as described above, is black. 
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2. Cg is white, and Cg_i is black. 

3. Cg is white, Cg-i is white, and e^-i is ahve. 

4. Cg is white, Cg_i is white, and Cg-i is not ahve. 

Let be A;, 1 < A; < 4, if case k holds. Thus, there is a /c, 1 < A; < 4, such that 



P(35, Zg = l^Cg = k)> \^P{^g, Zg = 1) (3.11) 



Case I. ( |3.11 ) is true with k set to 1. In this case, Cg is black. Let dg be the living cell just 



to the right of the effective zone of uncertainty. For Zg to be 1, dg must be at position 1 or 
greater. 

We wish to show that for each two consecutive 1-generation histories /i, i such that if 
H{g,g + 1) = h, Cg = 1, there exists a different collection of histories h' , i' , such that, for k 
depending only on G, we have 



P{H{g, g + l) = h', H{g + 1, ^ + 2) G i') > 
KP{H{g, g + l) = h,H{g + l,g + 2)= i) 



(3.12) 
(3.13) 
(3.14) 



and 



P{Xg+i = l\H{g,g + l) = h', (3.15) 

H{g + l,g + 2)ei')= (3.16) 

P{Zg = l\H{g,g + l) = h, (3.17) 

H{g + l,g + 2)=i) (3.18) 

Let h' be constructed as follows: 

1. Initial colors are the same as under h. 

2. Cells dg through dg + r die. 

3. Cell dg + r + l lives. 
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4. All other cells live or die as under h. Thus, cells dg through dg+r are the only ones with 
different color possibilities than under h; that is, they have a 50% chance of becoming 
black, with Cg as their parent. 

5. Cells dg through dg + r — 1 become white. 

6. Cell dg + r becomes black. 

7. All other cells become black or white as under h. 

At the end of h', we are left with exactly the same black cells as at the end of h, except 
that cell dg + r is black. And, because of cells added to the zone of uncertainty under h': 

P{H{g,g+ 1) = h') > ^L_P{H{g,g + 1) = h) (3.19) 
Also, h can be reconstructed if h' is known; that is: 

1. Initial conditions are the same for both histories. 

2. The location of cell dg -\- r can be recovered. After the completion of h\ it is the right 
black cell. Hence, the location of cell dg can be recovered. 

3. Under /i, all lifc/dcath and color decisions in the effective zone of uncertainty, through 
cell dg — 1, are the same. 

4. Under h, cell dg lives, thus bounding the zone of uncertainty. 

For Zg to be 1, in generation g + 1 the effective zone of uncertainty must not reach the 
nonnegative area. Therefore, d^+i must not be positive. Let H{g + 1,^ + 2) = i be such a 
history. Let i' be constructed as follows, given i and its predecessor h: 

1. Let initial colors be the same as under i, except that cell + r is black. (The position of 
dg can be determined, given h.) 

2. Let the life of all cells in the effective zone of uncertainty of i be determined as under i. 

3. Let cell dg + r — 1 live. Thus, since the effective zone of uncertainty of i stays in the 
negative area, all cells in this zone will face the same black/white decisions. Also, cells 
dg+i through dg + r — 2 must, if they die, become white. 
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4. Let cell dg + r die. 

5. Let cell dg + r + 1 live. Thus, cell dg + r will become white. 

6. Let all black/white decisions in the effective zone of uncertainty of i be determined just 
as under i. 

In this generation, cells (i^+i through dg + r — 2 can live or die without affecting the inclusion 
of a history in i' . Note that the only additional specification for what happens in i' , as opposed 
to i, is the life or death of three particular cells. 

Thus, we have 

P{H{g + 1, g + 2) G i'\H{g, g + l) = h')> (3.20) 
{asfPiHig + 1, g + 2) = i\Hig, g + I) = h) (3.21) 

Note that i can be recovered, given i', because all decisions in the effective zone of uncertainty 
of i are the same. Also note that conditions after i' are the same as after i. Thus, we have 



P(Zg+i = l\H{g, g + l) = h', H{g + 1, 5 + 2) G i') 
P{Zg = l\H{g,g + 1) = h,H{g + 1,5 + 2) = 



(3.22) 
(3.23) 



Since i' starts with exactly one nonnegative cell, at position r or greater, ( |3.15| ) holds. 
Combining ( p^ and (|3^ , we have ( |3.12| ) holding with k = 
Since there is a different h' , i' for each different h, i, we have 



2''+i ■ 



P{3g,Xg^, = l,Cg = l)> (3.24) 

J2P{Xg+i = l,Cg = l\ (3.25) 

g,h,i 

H{g, g + l) = h', H{g + 1, g + 2) G i') (3.26) 

P{H{g, g + l) = h', H{g + 1, g + 2) G i') > (3.27) 

Y,P{Zg = l,Cg = l\ (3.28) 

g,h,i 

H{g,g + l) = h,H{g + l,g + 2)=i) (3.29) 
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KP{H{g, g + l) = h,H{g + l,g + 2)=i)= (3.30) 
P{^g,Zg = l,Cg = l) (3.31) 



Thus, by our case hypothesis, we have 



P(3ff,X,+i = 1,C, = 1) > ^^P{3g,Zg = 1) (3.32) 



Case II. ( 3.11| ) is true with k set to 2. In this case, Cg is white, and Cg-i is black. Let 



be the hving cell just to the right of the zone of uncertainty, in generation g — 1. Note that this 
cell is to the right of any cells that are black in generation g. Hence, for Zg to be 1, dg^i must 
be at position 1 or greater. 

We wish to show that for each three consecutive 1-generation histories k, h, i such that if 
H{g,g + 1) = h, Cg = 2, there exists a different collection of histories k', h', j' such that, for k 
depending only on G, we have 



PiH{g -l,g) = k', Hig, g + 1) G h', H{g + 1, ^ + 2) G i') > (3-33) 
KP{H{g -1,5)= K H{g, g + I) = h, H{g + 1, g + 2) G i) (3.34) 

and 



P{Xg+i = l\H{g -l,g) = k', H{g, g + I) e h' , (3.35) 

H{g + l,g + 2)ei')= (3.36) 

P{Zg = l\H{g -l,g)= k, H{g, g + l) = h, (3.37) 

H{g + l,g + 2) = i) (3.38) 

Let k' be constructed as follows: 

1. Initial colors are the same as under k. 

2. Cells dg-i through dg-i + r die. 

3. Cell dg-i + r + 1 lives. 
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4. All other cells live or die as under k. Thus, cells dg-i through dg-i + r are the only 
ones with different color possibilities than under k; that is, they have a 50% chance of 
becoming black, with Cp_i as their parent. 

5. Cells dg-i through dg-i + r — 1 become white. 

6. Cell dg-i + r becomes black. 

7. All other cells become black or white as under k. 

At the end of k', we are left with exactly the same black cells as at the end of k, except that 
cell dg-i + r is black. And, because of cells added to the zone of uncertainty under k', we have 

P{H{g -l,g)=k')> ^L_P{H{g -l,g)=k) (3.39) 
Also, k can be reconstructed if k' is known; that is: 

1. Initial conditions are the same for both histories. 

2. The location of cell dg^i + r can be recovered. After the completion of k' , it is the right 
black cell. Hence, the location of cell dg-i can be recovered. 

3. Under k, all life/death and color decisions in the effective zone of uncertainty, through 
cell dg-\ — 1, are the same. 

4. Under k, cell dg-i lives, thus bounding the zone of uncertainty. 

Let H{g^g + 1) = /t be a history that, together with its predecessor fc, satisfies the conditions 
for Cg to be 2, and for Zg to possibly be 1: That is, under /i, let the leftmost living cell in the 

zone of uncertainty be white, and let this zone leave the nonnegative area. Let h' be constructed 
as follows, given h and its predecessor k: 

1. Let initial colors be the same as under h, except that cell dg-\ +r is black. (The position 
of dg can be determined, given h.) 

2. Let the life of all cells in the effective zone of uncertainty of h be determined as under h. 



49 



3. Let cell dg-i + r — 1 live. Thus, since under h the the effective zone of uncertainty does 
not reach this far to the left, all cells in this zone will face the same black/white decisions. 

Note that since under h the left border of the zone of uncertainty recedes, Cg ~ that is, 
the white cell at the border of this zone - must be to the right of cell dg-i + r. Also, cells 
Cg through dg-i + r — 2 must, if they die, become white. 

4. Let cell dg + r live. 

5. Let cell dg + r + 1 live. 

6. Let all black/white decisions in the effective zone of uncertainty of h be determined just 
as under h. 

In this generation, cells Cg through dg + r — 2 can live or die without affecting the inclusion 
of a history in h' . Note that the only additional specification for what happens in h', as opposed 
to h, is that three particular cells live. 

Thus, we have 



Note that h can be recovered, given h', because all decisions in the effective zone of uncer- 
tainty of h arc the same. 

For Zg to be 1, in generation g + 1 the effective zone of uncertainty must not reach the 
nonnegative area. Therefore, dg^i must not be positive. Let H{g + l,g + 2) = i he such a 
history. Let i' be constructed as follows, given i and its predecessors h and k: 

1. Let initial colors be the same as under i, except that cell dg-i + r is black. (The position 
of dg-i can be determined, given k.) 

2. Let the life of all cells in the effective zone of uncertainty of i be determined as under i. 

3. Let cell dg-i + r — 1 live. Thus, since the effective zone of uncertainty of i stays in the 
negative area, all cells in this zone will face the same black/white decisions. Also, cells 
dg+i through dg-i + r — 2 must, if they die, become white. 



P{H{g,g + l)Eh'\H{g^l,g) = k')> 
{a^fP{H{g, g + l)= i\H{g -l,g) = k) 



(3.41) 



(3.40) 
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4. Let cell dg-i + r die. 

5. Let cell dg-i + r + 1 live. Thus, cell dg-i + r will become white. 

6. Let all black/white decisions in the effective zone of uncertainty of i be determined just 
as under i. 

In this generation, cells d^+i through dg^i + r — 2 can live or die without affecting the 
inclusion of a history in i'. Note that the only additional specification for i', as opposed to i, is 
the life or death of three particular cells. 

Thus, we have 

P{H{g + l,g + 2) (3.42) 
H{g,g + l)eh',H{g-l,g)=k')> (3.43) 
{a3fP{H{g + l,g + 2)=i\ (3.44) 
H{g,g + l) = h,H{g-l,g)=k) (3.45) 

Note that i can be recovered, given i', because all decisions in the effective zone of uncertainty 
of i are the same. Also note that conditions after i' are the same as after i. Thus, we have 



P{Zg+i = 1| (3.46) 

H{g-l,g) = k', H{g, g + I) e h' , H{g + l,g + 2)Gi')= (3.47) 

P{Zg = 1| (3.48) 

H{g -1,5)= k, H{g, g + 1) = h,H{g + l,g + 2) = i) (3.49) 

Since i' starts with exactly one nonnegative cell, at position r or greater, ( 3.35| ) holds. 
Combining ( p9D , (|3lO| ), and (Q), we have ( p3| ) holding with k = 
Since there is a different /c', h' , i' for each different k, h, i, we have 



P{3g,Xg+i = l,Cg = 2)> (3.50) 

^ P{Xg+l = l,Cg = 2\ (3.51) 
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Hig -l,g) = k\ H{g, g + 1) e h' , H{g + 1, 5 + 2) G i') (3.52) 

P{H{g -1,5)= k', H{g, g + I) & h' , H{g + 1, 5 + 2) G i') > (3-53) 

P{Zg = l,Cg = 2\ (3.54) 

g,k,h,i 

H{g -l,g) = k, H{g, g + I) = h, H{g + 1, g + 2) = i) (3.55) 

KP{H{g -l,g)=k, H{g, g + 1) = h, H{g + 1, g + 2) = i) = (3.56) 

P{3g,Zg = l,Cg = 2) (3.57) 

Thus, by our case hypothesis, we have 

P{3g,Xg+i = l,Cg = 2)> ^^P{3g,Zg = 1) (3.58) 



Case III. ( |3.11| ) is true with k set to 3. In this case, Cg is white, and Cg^i is white. Let hg-i 
be the white ceh just to the right of -Dg-i. In this case, equals Cg_i. 

We wish to show that for each three consecutive 1-generation histories /c, /i, i such that if 

H{g,g + 1) = h, Cg = 3, there exists a different cohection of histories k', h', j' such that, for k 
depending only on G, we have 

PiHig -l,g)£ k', H{g, g + I) £ h', Hig + 1, g + 2) e i') > (3-59) 

KP{H{g-l,g)=k) (3.60) 

PiH{g,g + l) = h\Hig-l,g)=k) (3.61) 

P{H{g + l,g + 2) = i\ (3.62) 

H{g-l,g)=k,H{g,g + l) = h) (3.63) 

and 

P{Xg+^ = l\H{g-l,g)ek',H{g,g + l)eh', (3.64) 

Hig + l,g + 2)ei')= (3.65) 

P{Zg = l\H{g -l,g)= k, Hig, g + I) = h, (3.66) 

H{g + l,g + 2)=z) (3.67) 

Let k' be constructed as follows: 
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1. Initial colors are the same as under k. 

2. Both the leftmost and rightmost cells in D live (cells bg-i + 1 and Cg-i — 1). Thus, all 
cells in D must become black. 

3. Cells Cg-i through Cg-i + r die. 

4. Cell eg-i + r + 1 lives. Thus, cells Cg-i through e^-i + r may become either black or 
white. 

5. All other cells, up to the left border of the zone of uncertainty of k, live or die as under 
k. In specific, bg-i lives, as under k. Thus, all cells to the left of bg-i are faced with the 
same black/ white decisions as under k. 

6. Cells Cg-i through Cg-i + r — 1 become white, and cell Cg-i + r becomes black. 

7. All other cells become black or white as under k. 

Note that all cells in -Dg-i, except for those on each border, can live or die without affecting 
the inclusion of a history in k'. 

At the end of any history in k', we are left with exactly the same black cells as under k, 
except that all cells in -Dg-i are black and cell e^-i + r is black. 

Now, consider those cells in the interior of Dg^i. Under k, they must all die; under k', their 
life or death does not matter. On the other hand, the two cells at the border of -Dg-i die under 
k, and live under k'. Also, cells Cg-i through eg_i + r are outside the zone of uncertainty under 
k. Under k', they die, and their colors are specified. 

Thus, if n is the maximum of — 2r and 0, we have 

PiHig -l,g)ek')> ^J^^^^P{H{g -l,g)=k) (3.68) 
Also, k can be reconstructed if k' is known; that is: 

1. Initial conditions are the same for both histories. 

2. Under k, all life/death and color decisions in the effective zone of uncertainty, up to cell 
bg-i, are the same. 
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3. The location of cell bg-i can be recovered. After the completion of k', it is the rightmost 
white cell in the next-to-rightmost finite white domain. 

4. Cell bg-i lives, as under k'. 

5. The location of cell Cg-i can be recovered. After the completion of k', it is the leftmost 
cell in the rightmost finite white domain. 

6. Under k, cells bg^i + 1 through ep_i — 1 die, and become white. 

7. Under k, cells e^-i and all cells to the right of it are outside the zone of uncertainty. 

Let H(g, g + l) = hhe a history that, together with its predecessor k, satisfies the conditions 
for Cg to be 3, and for Zg to possibly be 1. That is, under both k and h, let the leftmost living 
cell in the zone of uncertainty be white. Thus, since the right border of this zone will recede in 
generation g — 1, Dg is completely to the left of Dg^i. Also, in generation g, let this zone leave 
the nonnegative area; and let bg-i be alive. 

Let h' be constructed as follows, given h and its predecessor k: 

1. Let initial colors be the same as under h, except that cell e^-i -|- r, and all cells in Dg-i, 
are black. (The location of -D^-i, and hence of cells bg-i and e^-i, can be determined 
given k.) 

2. Let the life of all cells in the zone of uncertainty of h be determined as under h. (Note 
that Dg^i is to the right of this zone.) Furthermore, let cell Bg live or die as under h. 

3. Let the white cells at each border of -Dp-i - that is, cells bg-i and Cg-i - live. 

4. Let all cells in -Dp-i die. Thus, they must all become white. 

5. Let cell eg + r — 1 live. 

6. Let cell Cg-i + r live. 

7. Let cell e^-i -I- r -I- 1 live. 

Note that in generation g, cells eg through e^-i - that is, the cells between the border of 
the zone of uncertainty of h and the left border of -Dg-i - can live or die without affecting the 
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inclusion of a history in h! . Also, cells e^-i + 1 through e^-i + r — 2, (if r is large enough for 
these cells to exist) can live or die without affecting this inclusion. 

At the end of any history in h! , we are left with exactly the same black cells as under h, 
except that cell e^-i +r is black. Now, since e^-i > > 0, we have e^-i +r) > r. And for Zg 
to be 1, there must be no nonnegative black cells at the end of generation g. Thus, at the end 
of h! there will be only one nonnegative black cell, cell e^-i + r. 

Now, consider those cells in the interior of -Dg-i- Under /i', they must all die; under /i, 
they are outside the zone of uncertainty. Also, those cells r or less to the left of -D^-i (cells 
— 1 through hg-\ — r may have different life probabilities. Finally, we have to consider the 
life probabilities of cells e^, and eg + i — 1 through + r + 1. 

Thus, if n is the maximum of — 2r and 0, we have 

P{H{g,g + 1) G h') > {asf'+\l - a^TP{H{g,g + 1) = h) (3.69) 
Also, h can be reconstructed if h' is known. That is, 

1. Under h' , -Dp-i is the second black domain on the left. 

2. Under h, initial conditions to the right of Dg^i are the same as under h! . 

3. Under h, the zone of uncertainty does not reach Dg-\. 

4. Decisions in the zone of uncertainty of h, and at its border, both life/death and black/white, 
are exactly as under h. 

Now, for Zg to be 1, in generation ^ + 1 the effective zone of uncertainty must not reach 
the nonnegative area. Therefore, dg+i must not be positive. Let H{g + 1,^ + 2) = i be such a 
history. Let i' be constructed as follows, given i and its predecessors h and k: 

1. Let initial colors be the same as under i, except that cell dg-\ + r is black. (The position 
of dg-i can be determined, given k.) 

2. Let the life of all cells in the effective zone of uncertainty of i be determined as under i. 

3. Let cell + r — 1 live. Thus, since the effective zone of uncertainty of i stays in the 
negative area, all cells in this zone will face the same black/white decisions. Also, any 
cells between d^+i and dg-i + r — 2 must, if they die, become white. 
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4. Let cell dg-i + r die. 

5. Let cell dg-i + r + 1 live. Thus, cell dg-i + r will become white. 

6. Let all black/white decisions in the effective zone of uncertainty of i be determined just 
as under i. 

In this generation, cells d^+i through dg^i + r — 2 can live or die without affecting the 
inclusion of a history in i'. Note that the only additional specification for i', as opposed to i, is 
the life or death of three particular cells. 

Thus, 

P{H{g + l,g + 2) (3.70) 
H{g,g + l)eh',H{g-l,g)=k')> (3.71) 
{a3fP{H{g + l,g + 2)=i\ (3.72) 
H{g,g + l) = h,H{g-l,g)=k) (3.73) 

Note that i can be recovered, given i', because all decisions in the effective zone of uncertainty 
of i are the same. Also note that conditions after i' are the same as after i. Thus, we have 

PiXg+i = 1| (3.74) 

H{g - 1, 5) G k', H{g, g + I) £ h', H{g + 1, ^ + 2) G i') = (3.75) 

P{Zg = 1| (3.76) 

H{g -l,g) = k, Hig, g + I) = h, H{g + I, g + 2) = i) (3.77) 



Since i' starts with exactly one nonnegative cell, at position r or greater, ( 3.35| ) holds. 

/ \4r + 10 

Combining ( pS)) , (||6|), and (|]7^), we have ( p9| ) holding with k = . 
Since there is a different /c', h' , i' for each different k, h, i, we have 



P(3g,Xg+i = l,Cg = 3)> (3.78) 

^ P{Xg+l = l,Cg=3\ (3.79) 
g,k,h,i 
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Hig -l,g)e k', H{g, g + 1) e h' , H{g + 1, 5 + 2) e i') (3.80) 

P{H{g - 1, g) G k' , H{g, g + I) € h',H{g + 1, g + 2) G i') > (3-81) 

^ P{Zg = l,Cg=3\ (3.82) 

g,k,h,i 

H{g -l,g) = k, H{g, g + I) = h, H{g + 1, g + 2) = i) (3.83) 

KPiHig -l,g)= k, Hig, g + 1) = h, H{g + 1, g + 2) = i) = (3.84) 

Pi3g,Zg = l,Cg = 3) (3.85) 

Thus, by our case hypothesis, we have 



P{3g,Xg+i = 1,C, = 3) > ^^P{3g,Zg = 2) (3.86) 



Case IV. ( p. 11 ) is true with k set to 4. This case can be handled almost exactly the same 
as Case III. The only difference between the two is that, in Case IV, cell bg-i is not alive in 
generation g — 1. Under k', this cell lives; and in this case, if k is reconstructed from k', it is 
assumed that this cell is not alive. Since, under k, the nearest living cell to the right of bg-i is 
white, all black/white decisions to the left of bg-i are the same for k' as for k. I 

Lemma 3.13 // there is positive probability that, given any finitely describable initial condi- 
tions, the zone of uncertainty will expand arbitrarily far to the left (right) only, there is positive 
probability a that, given a zone of uncertainty consisting of two, three or four, contiguous black 
cells: 

1. The effective zone of uncertainty will expand arbitrarily far to the left, never again going 
to the right of the position of the original black cells. 

2. The effective zone of uncertainty will never contain less than two black cells. 
Proof. Let ai be the smallest probability that any cell will live; and Q2 the largest. 



By Lemma 3.10, if under any initial conditions there is positive probability the zone of 
uncertainty will expand arbitrarily far to the left only, there is positive probability that under 
these conditions the left border of the effective zone of uncertainty will expand arbitrarily far 
to the left, and the right border recede arbitrarily far to the left. 
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By Corollary |3.5| , if there are initial conditions under which there is positive probability 
of the effective zone of uncertainty behaving as above, then, for any e > 0, there are initial 
conditions 1^ under which there is probability 1 — e of it behaving as above. 

Now, suppose that under there is probability 1 that the zone of uncertainty will eventually 
contain one cell. Then there is probability 1 — a2 that this zone will eventually disappear. If e 
is small enough, this is a contradiction. 

Therefore, at least for small enough e, under conditions le, there is positive probability that 
the zone will not only behave as above, but always contain at least two cells. Let 7 be one such 
probability, for any particular conditions I^. Let c be the cell on the right border of I^- 

Now, under I^, there must be some n, such that that there is probablity at least ^ the zone 
of uncertainty will never reach cell c + n. Let m be the length of the zone of uncertainty under 
/e, plus n. 

The proof is completed by noting that if there are two black cells in the zone of uncertainty, 
there is probability at least ai(l — a2)'"ai that the right black cell lives, its m neighbors on the 
right die, and the next white cell lives. Given this, there is probability ^"^ that the cells that 
die form the pattern of I^, with n white cells to the right. Finally, given this pattern that is 
just like that of 1^, except for one black cell c, n units to the right, there is probablity at least 
^ai(l — 02)^ that c dies, its two neighbors live, and the rest of the zone does not ever reach 
cell c. 

Thus, there is probability at least a = ■^(ai)'^(l — 02)™'^'^^'" of events transpiring as desired. 

I 

The main theorem now follows. 

Theorem 3.14 (The Double Glider Theorem) Let G be a simple cellular game of radius 
r, with left/ right symmetry. Then, under G, with finite initial conditions, the probability that 
the zone of uncertainty will extend arbitrarily far in one direction only is zero. 

Proof. Suppose that under G, under any finite initial conditions, there is positive probability 
of the zone of uncertainty extending arbitrarily far to the left (or right) only. Without loss of 
generality, since G is symmetric, let us say the left. 

Then, by Lemma 3.10| , there is positive probability that both left and right effective borders 



of the zone of uncertainty will move arbitarily far to the left. Since this refers to a countable 
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Boolean combination of finite histories, in which no finite history determines membership, 
Corohary can be apphed. That is, for any e > 0, there are fixed initial conditions such 
that, given these initial conditions, the probability of this happening is greater than 1 — e. 

Since this is true for any e > 0, let us assume that e < where ai is the smallest 
probability, under G, that any cell will stay alive. 

Also, without loss of generality, let the rightmost black cell, under 1^, be regarded as cell 
0. Thus, there is probability at least 1 — e that, in some generation g, the rightmost cell in the 
effective zone of uncertainty will be at a nonnegative position, and in all subsequent generations 
at a negative one. 

Thus, satisfies the conditions for Lemma |3.12| . That is, there is a constant 7 such that 
if, under I^, this crossover does occur, the probability it does so in a generation in which, at 
the beginning of the generation, there is only one nonnegative black cell (and that cell is at 
position r or greater) is at least 7. This 7 is not dependent on any other characteristics of 1^, 
but only on G. 

Let Xg be 1 if: 

1. At the beginning of generation g, there is only one nonnegative black cell. 

2. In generations g+1 and later, the effective zone of uncertainty stays out of the nonnegative 
area. That is, it no longer contains nonnegative cells. 

Let Xg be otherwise. 

Thus, given initial conditions 1^, we can say that 

7(1 -e)<J2 P{Xg = 1, Xk = OVA; < g) = (3.87) 
a 

J2 P{H{1, 9) = h)P{Xg = l,Xk = OVA: < g\H{l, g) = h) (3.88) 

Note that if X^, with A: < 17 is 1, Xg must be 0; that is, the effective zone of uncertainty 
can leave the nonnegative area for the last time in only one generation. Thus, the left side of 
( 3.87| ) becomes 

^ P(F(1, g) = h)P{Xg = l\H{l, g) = h) (3.89) 
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Separating out the effects of the next generation, we get 



^ P{H{1, g) = h)P{H{g, g + 1) = h'\H{l, g) = h) (3.90) 

g,h,h' 

P{Xg = l\H{l, g) = h, H{g, g + I) = h') (3.91) 

Now, for it to be possible that Xg be 1, the cell history in generations 1 through g — 1 must 
meet certain conditions. That is, at the beginning of generation g there must be only one black 
nonnegative cell, at position r or greater; in other words, Fi{H{l, g)) must be 1. In addition, 
the history of generation g must meet certain requirements. That is, in generation g + 1 the 
zone of uncertainty must contain only negative cells; in other words, F2{H{g,g + 1)) must be 
1. Thus, ( 3.90| ) becomes 



P{H{l,g)=h)Fi{H{l,g)) (3.92) 

g,h,h' 

P{H{g,g + l)=h'\H{l,g)=h) (3.93) 

F2{H{g, g + l))P{Xg = l\H{l, g) = h, H{g, g + I) = h') (3.94) 

Now, given initial conditions J^, the probability that the zone of uncertainty does not extend 
arbitrarily far to the left only (that is, that it extends arbitrarily far to the right, or eventually 
disappears) has to be less than e. Since e is arbitrary, showing that this probability must be 
greater than some constant dependent only on G will force a contradiction. 

To show this, let r{g) be the position of the rightmost cell in the effective zone of uncertainty 
in generation g. Furthermore, let p be the probability that the zone extends arbitarily far to 
the right, or eventually disappears. Then p is larger than the probability that one domain in 
the middle of the zone of uncertainty grows arbitrarily large in both directions. This, in turn, 
is larger than the probability that, for some generation g all the conditions below hold: 

1. In generation g, there is only one nonnegative black cell c, at position r or greater. 

2. In generation 5 + 1, there are two, three or four nonnegative black cells, both next to each 
other, and both at positions r or greater. 

3. The white domain D which in generation g is between cell c and all other black cells, 
grows arbitrarily large in both directions. 
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4. In generations g + 2 and later, either the leftmost living cell of D is at position or less, 
or the leftmost cell in D is at position or less, and the leftmost living cell after that is 
white. That is, the left effective border of D is always at position or less. 

5. In generations g + 2 and later, either the rightmost living cell of D is at position r — 1 or 
less, or the rightmost cell in D is at position r — 1 or less, and the rightmost living cell 
after that is white. That is, the right effective border of D is always at position r — 1 or 
less. 

6. In generation g + 2 and after, there are always more than two black cells to the right of 
D; that is, at positions r or greater. 

That is, a white domain D develops in generation g, and the two "gliders" on each side of 
D in that generation fly apart, and never touch. The right glider, after generation g, always 
contains at least two black cells; and both gliders continue to exist forever. 

Now, we examine the probability of these events happening. Let 1^ be 1 if the above events 
are satisfied for generation g, and otherwise. 

Thus, the probability that the zone of uncertainty grows arbitrarily large in both directions 
is greater than 

P{H{1, g) = h)P{Yg = l,Yk = Oyk< g\H{l, g) = h) (3.95) 

Now, Yg and 1^, with k < g, cannot both be 1. The reason for this is that for Y^ to be 
true, there must be exactly one black nonnegative cell in generation k, and never again. Thus, 
( 3.95| ) is equivalent to 

J2 P{H{1, g) = h)P{Yg = 1\H{1, g) = h) (3.96) 
or, separating out the effects of generation 5, we have 

^ P{H{1, g) = h)P{H{g, g + I) = h'\H{l, g) = h) (3.97) 

g,h,h' 

P{Yg = l\H{l, g) = h, Hig, g + I) = h') (3.98) 
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For 1^ to be 1, the cell history in generations 1 through g — 1 must meet the same conditions 
that enable Xg to be 1; that is, in generation g there must be only one black nonnegative cell, at 
position r or greater. In addition, the history of generation g must meet certain requirements. 
That is, in generation g + 1 there must be two or more black nonnegative cells, both next to 



each other, and both in positions r or greater; that is, F^[H[g,g + 1)) must be 1. Thus, ( 3.90 ) 
becomes 



P{H{l,g)=h)F^{H{l,g)) (3.99) 

g,h,h' 

P{H{g,g + l) = h'\H{l,g)=h) (3.100) 

F^{H{g,g + l))P{Yg = l\H{l,g)=h,H{g,g + l)=h') (3.101) 



By Lemma 3.11 , for every 1-generation history /i2 such that F2{h2) = 1, there is a constant 



13 depending only on G, and a 1-generation history /13 such that 

1. F3(/l3) = 1. 

2. Initial conditions are the same as under h2- 

3. For any previous history (starting at generation 0) /i, we have 



P{H{g,g + l) = h^\H{l,g)=h)> (3.102) 
pP{H{g,g + l) = h2\H{l,g) = h) (3.103) 

4. At the end of generation g, given history /13, the negative black cells are exactly the same 
as those at the end of g given /i2. 

Furthermore, for no two /12 will this /13 be the same. 



Thus, ( 3.99| ) is greater than 



^ P{H{l,g) = h)Fi{H{l,g)) (3.104) 

g,h,h' 

(3P{H{g,g + l) = h'\H{l,g) = h) (3.105) 

F2{H{g,g + l))P{Yg = l\H{l,g) = h,H{g,g + 1) = h') (3.106) 
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For Yg to be true, the white domain D must, from that point on, include at least cells 
through r. Therefore, by Theorem 3^, in all infinite histories for which Yg is 1, and all finite 
histories in which the possibility of Yg remaining 1 stays open, the actions of cells on the two 
sides of D remain independent of each other. Hence, these actions can be considered separately, 
as if we were dealing with two different games. Thus, at the beginning of generation g + 2, 
the probability that behavior on both sides of D will be appropriate is the product of the 
probabilities of appropriate behavior on each side. 

The probability that the behavior on the left side is appropriate is the same as the probability 
that behavior on the left side would be appropriate if, at this point, the negative black cells 
were exactly the same as they are now, but there were no nonnegative black cells. 

Similarly, the probability that behavior on the right side is appropriate is just the probability 
that all behavior is appropriate, if the zone of uncertainty consisted only of two, three or four 
contiguous black cells. By Lemma 3.13| , this probability is at least a. 

Note that this is where the left-right symmetry of G comes in; that is, the probability a 
symmetric zone of uncertainty will glide arbitrarily far to the left only must be the same as the 
probability it will glide arbitrarily far to the left only. 

Thus, (|l0|) becomes 



^ P{H{l,g) = h)F,{H{l,g)) (3.107) 

g,h,h' 

pP{H{g,g + l) = h'\Hil,g)=h) (3.108) 
F2{H{g,g + l))P{Xg = l\H{l,g) = h,H{g,g + 1) = h')a (3.109) 

This sum is less than the probability, given initial conditions 1^ , that the zone of uncertainty 
will expand arbitarily far in both directions; however, by comparison to (3.87) through ( 3.92| ), 



it is seen to be greater than (3a^{l — e), with a, /3, and 7 depending only on the game, not on 
the initial conditions. If e is small enough, this contradicts the assumption that, given these 
conditions, this probability must be less than e. I 
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3.3 Standard Restricted Initial Conditions 



It may be useful to consider another form of finitely describable initial conditions, defined as 
follows: 

Definition 3.15 Standard restricted initial conditions are conditions such that there is 
a rightmost black cell, and a leftmost white cell. 

In other words, under standard restricted initial conditions, an infinite black domain is 
followed, left to right, by none, two, or any other even number of finite domains (of alternate 
colors), followed by an infinite white domain. 

The zone of uncertainty is defined similarly as for finitely describable initial conditions. 

Definition 3.16 Under standard restricted initial conditions, the zone of uncertainty con- 
sists those finite domains (if any), in between the two infinite domains. 

In some respects, the behavior of cellular games under these conditions is easier to analyze. 
That is, if there are finitely many black cells there is always positive probability that all black 
cells die out. This essentially ends the course of the game; thus, it makes it more awkward 

to discuss the long-term behavior of a system. Under standard restricted initial conditions, 
however, the two infinite domains cannot merge, and cells of each color will always be present. 
Behavior under standard restricted initial conditions can be delineated as follows: 

Theorem 3.17 Let G be a simple cellular game. Then, under standard restricted initial con- 
ditions, one, but not both, of the two statements below hold: 

1. The zone of uncertainty will, almost always, become empty infinitely many times. 

2. It will, almost always, become empty only finitely many times. 

Proof. Suppose G is such that, when the zone of uncertainty is empty, there is positive 
probability p it is for the last time. Then the probability that it will reach minimal size 
infinitely many times is 

lim(l-p)" = (3.110) 

n— >oo 



64 



Definition 3.18 A clumping process is a simple cellular game in which, under standard 
restricted initial conditions, the zone of uncertainty almost always becomes empty infinitely 
many times. 

Definition 3.19 Let a simple cellular game in which this zone, almost always, becomes empty 
only finitely many times be called a mixing process. 

Now, there is another kind of symmetry which may be appUed to cellular games; namely, 
they may be black/white symmetric, as well as left/right. 

We examine clumping processes which have both symmetries. We show that if G is a 
clumping process with both such symmetries, each cell will change color infinitely many times. 
To do this, we use a theorem which can be applied to all symmetric, one-dimensional random 
walks with the Markov property. In this theorem, we show that the walker will cross any 
position infinitely many times. (In the "usTial"' walk, in which the walker can only move one 
unit at a time, this means that the walker will visit every position infinitely many times.) 

Theorem 3.20 Let M be a one- dimensional random walk with the Markov property. Let X{t) 
be the position of that walk at time t. Let Pq.i equal pQ > 0, Po,fc equal Pi^ij^k^i, and Po,fc 
equal P^-k for all k. Then, for any n, any g, and any value of X{g), the quantity P(3h,h > 
g,X{h) < n) equals P{3h,h > g,X(h) > n), and they both equal 1. That is, this random walk 
will almost always cross every position infinitely many times. 

Proof. First, the probability that the X(g) will stay bounded is 0. That is, suppose it were 
not. Then, there would be some n such that 

P(n = lim sup >0 (3.111) 

fc— >oo 

However, we know P-n-n-i = F'n,n+i = Po > OVn. Therefore, if the walk reaches position 
n {—n) infinitely often, it will almost always reach position n + 1 {—n — 1) infinitely often. 

We now show that the probability that there are infinitely many k, such that X{k) is not 
the same sign as X{k + 1), is 1. 

Let a sequence {Ci} with each Ci G {—1,1}, and integer sequences {ki} and {nj}, be 
constructed as follows: By the above discussion, we know that, with probability 1, there must 
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eventually be a A; for which |-^(A;)| > 2. Let ki be the first A; for which this is true, and let 
m = X{ki). Let Ci be 1 if X{ki) > 2, and -1 if X{ki) < -2. 

Given Cj_i, fc^-i, and n^-i, such that X{ki) = n^, let Q, A;,, and be constructed as 
follows. Let ki be the first k such that |X(A;j) — > n^-i; note that there will almost always 
be such a ki. Let = X{ki), and let Cj = 1 if nj > 2ni_i, and —1 if rii < 2nj_i. Thus, if Ci is 
a different sign from Ci_i, then X{ki) will be a different sign from X(ki-i). 

Now, since Po,-ik = -Po,fe = Pn,n+k^'n, k the probability that each Ci is the same sign as the 
previous is ^. Since the each Q is independent of all others, they will, therefore, almost always 
change sign infinitely many times. 

The same argument can be used to show that, for any c, X{k) — c will change sign infinitely 
often, and hence that any point will be crossed infinitely many times. I 

Corollary 3.21 Let G be a clumping process with both left/right and black/white symmetry. 
Let G evolve under standard restricted initial conditions. Then, under G, each cell will, almost 
always, change color infinitely many times. 

Proof. Let X{i) be the position of the leftmost cell in the white domain, the ith time the 
zone of uncertainty is empty. Then we know there will, almost always, be infinitely many X{i). 
Since cellular game evolution is independent of exact location, Po,fe = Pn,n+k^n, k. Since G is 
symmetric in both senses, Po,-fc will equal Po,fc for all k. 

Now, let a be the smallest probability that any cell lives, and 13 the largest. By definition, 
they are both positive. Let the zone of uncertainty be empty in generation g for the ith time. 
There is probability at least a(l — (3)a that cell X{i) — 1 lives, cell X{i) dies, and cell X(i) + 1 
lives. Given these events, there is probability ^ that cell X{i) becomes white in the next 
generation, thus ensuring that X(i + 1) = X{i) + 1. Thus Px{i),x{i)+\ > ^'^d hence Po,i and Po,-i 
must be positive. Therefore the process X(0), . . . , X{n), . . . satisfies the requirements of 

the above theorem. I 

Similar results, however, have not yet been obtained for mixing processes. That is, we 
cannot show that for mixing processes with both left/right and black/white symmetry, evolving 
under standard restricted initial conditions, the zone of uncertainty will, almost always, expand 
arbitrarily far in both directions. 
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As shown before, there cannot, under these conditions, be a "ghder" with two domains of 
the same color on each side of it. This does not automatically imply that there cannot be a 
"glider" with two domains of different colors on each side of it. However, the one fact does 
suggest the other, which is here presented as a conjecture. 

Conjecture 3.22 Let G be a simple cellular game with both left/right and black/white sym- 
metry. Then, under standard restricted initial conditions, the probability that the zone of un- 
certainty will expand arbitrarily far in one direction only is 0. 

Note that if this conjecture is true, it can be shown that under both finite and standard 
restricted initial conditions, no finite domain D (with probability 1) will grow arbitrarily large. 
This would be done by considering the two areas between D and the infinite domains on the left 
and right to be gliders. Since D will grow arbitrarily large, each of these gliders could be shown 
not to be affected by what happens on the other side of D. They could thus be considered to be 
"gliding" arbitrarily far in one direction, between two infinite domains. By Theorem 3.14| (The 
Double Glider Theorem), this is not possible if the two domains are the same color; and, if the 
above conjecture is true, this would not be possible if the two domains are different colors. 



3.4 Examples 

At this point, one may ask if either mixing processes or clumping processes exist. Computer 
simulations suggest that both kinds of behavior are indeed possible. 

The experiments described in this chapter simulate one-dimensional simple games of radius 
1. In these games, the life probability of a cell is one value, pi, if it is the same color as both 
of its neighbors, and a different value, p2, otherwise. These games are thus both left/right and 
black/white symmetric. Let such games be called "join/mix" processes. 

Using the definition of simple cellular game, these processes can be specified more formally 
as follows: 

• There is one cell for each integer, or each integer mod k. 

• In each generation, each cell is either white or black. 

• If a cell is the same color as both of its neighbors, its probability of living in that generation 
is pi > 0. Otherwise, its probability of living is p2 > 0. 
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• If a cell lives in a generation g, it keeps its color in generation g + 1. 

• If a cell dies in generation g, its color in generation + 1 is either that of its nearest living 
neighbor to the left, or to the right, with a 50% probability of each. 

• If, in generation ^, a cell has no living neighbors on each side, it has a 50% probability of 
assuming either color in generation g + 1. 

In computer experiments, games of this type are run on a circular lattice of cells. Initially, 
two black domains are placed in a mostly white area. Figure D.19 shows how results vary as 
pi and p2 vary. That is, if pi is high, there seems to be little noise at the borders between 
domains. In such cases, p2 determines the rate of domain movement. If, on the other hand, pi 
is low and p2 high, the noise between domains seems to grow so fast it quickly takes over the 
ring. If pi and p2 are both low, the asymptotic behavior of the process is not readily apparent. 
However, the resemblance to natural structures is noticeable. 

Definition 3.23 The join/mix game such that pi = 0.85 and p2 = 0.15 is called the the Join 
or Die Process. 

The process is given this name because a cell must join; that is, be the same color as both of 
its neighbors, or else it is very likely to die. Computer simulations suggest that the Join or Die 
process is, in fact, a clumping process. That is, the area of "noise" between two large domains 
appears to stay, quite small most of the time. We thus conjecture: 

Conjecture 3.24 The Join or Die process is a clumping process. That is, if it evolves under 
standard restricted initial conditions, the zone of uncertainty will almost always become empty 
infinitely many times. 

Now, consider what happens, under the Join or Die or other clumping processes, to "normal" 
or "almost all" initial conditions. Let us suppose that average domain size will, almost always, 
grow arbitrarily large. Thus, after many generations, most cells in any given section of the 
lattice would, most likely, be in extremely large domains; and a visual depiction of this section 
would show large domains, with a noisy boundary between them (consisting of small domains, 
many containing no living cells). The noisy boundary between two such large domains would. 
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therefore, move in some sort of symmetric random walk; and it might be unhkely that the noise 
in the boundary would grow to significant size, compared to the domains it bordered. 

Thus, the evolution of such a process might be very similar to that of a process in which the 
size of the "noise" between domains stayed bounded. Let us suppose, without loss of generality, 
that the size of the "noise" stayed at one cell. Let us describe such a model (which is not a 
cellular game) as follows: 

• There is one cell for each integer. 

• Each cell, at each time, is in either a black, white, or gray state. 

• Gray domains, which may be no more than one cell wide, are called "particles." Particles 
separate black and white domains, which alternate. 

• Particles move either to the right or left, in accordance with some symmetric random 
walk. 

• If two particles meet or cross, then two white domains have absorbed a black domain (or 
two black domains a white one). Thus, these two particles, which represent the boundaries 
between two domains, disappear. 

This is, exactly, a stochastic process discovered by Erdos and Ney |Q and called the anni- 
hilating particle model. And, computer simulations do, indeed, show apparent similarities of 
behavior. These similarities suggest that study of one subject may shed light on the other. 

Another join/mix game is the Mixing Process. 

Definition 3.25 The join/mix game such that pi = 0.15 and p2 = 0.85 is called the the 
Mixing Process. 

That is, the probabilities are exactly reversed from those used for the Join or Die process. As 
this process evolves, computer experiments suggest that the "noise" between two large domains 
is likely to grow with time. 

Conjecture 3.26 The Mixing Process is a mixing process. That is, if it evolves under standard 
restricted initial conditions, the zone of uncertainty will almost always grow arbitrarily large. 
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Appendix A 

Computer Experiments 



All computer experiments were done in Turbo Pascal, Version 4.0, using the built-in pseudo- 
random number generator. Source code is available from levine@symcom.math.uiuc.edu. 

The program simulating the modified Arthur-Packard-Rogers model, with Stag Hunt pa- 
rameters, is cg2.pas. Note that in this program all strategies are mixed; that is, there is a 
small probability of actions other than those called for by the pure strategy. 

The simulations of zero-depth, one-round models are as follows: In Section |2|: The Cloud 
Process, cloud. pas, the Prisoner's Dilemma, prisoner .pas, the Stag Hunt (first version), 
stag. pas, and the Stag Hunt (second version), stag2.pas. In Section|3|: The square of different 
join/mix processes, square. pas, the Join or Die Process, jd.pas, the annihilating particle 
model, apm.pas, and the Mixing Process, mix. pas. 
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Appendix B 

The Prisoner's Dilemma 



The Prisoner's Dilemma is a two-person game in which two types of moves are possible: coop- 
erate, and defect. This game models the options of two prisoners held in separate cells for the 
same crime, who are being pressured to confess to that crime. 

If both prisoners keep silent ~ that is, they cooperate with each other - they will both get 
a small sentence for a lesser crime. If they both talk - that is, they both defect - they both 
get the standard sentence. If one talks and the other does not, the one that kept silent gets 
a very severe sentence and the other goes free. Thus, Prisoner's Dilemma is a game in which 
a player's reward for defecting, while the other player cooperates, is highest. Next highest is 
the reward for mutual cooperation; then, the reward for mutual defection. Lowest of all is the 
reward for cooperating while the other player defects. 

The Prisoner's Dilemma can also be generalized to three-person games. For more informa- 
tion on the Prisoner's Dilemma, see Q and [|l^]. 



71 



Appendix C 

The Arthur-Packard-Rogers Model 



The computer experiments presented in use a model very similar to the one described in 

m- 

That is, there exists a circular ring, or doubly infinite lattice, of cells C. Associated with 
each cell c, in each round i of each generation g, are: 

• A move variable rric^i^g from some finite alphabet S of A; characters. 

• A strategy variable Sc,g- This is a table, in which entries are from S. If strategies are of 
depth d and radius r (that is, moves of the r nearest neighbors of a cell, up to d rounds 
back, are taken into account), then this table contains entries. There are hence 
jj.d(2r+i) pQgg-|-j^g strategies. Note that strategies do not change in a generation, but they 
do take into account rounds in previous generations. In computer experiments, move and 
strategy variables are initialized with the aid of a pseudorandom number generator. 

A finite number of mixed, that is, stochastic, strategies may also be implemented; that is, 
strategies in which, given at least one game history, there is positive probability of a cell 
making two different moves. For example, a mixed strategy for Prisoner's Dilemma would 
be to cooperate 95% of the time, and defect the other 5%. If a given game allows k moves, 
and k' mixed courses of action, there are {k + /j')^'*'^'^^' possible strategies. Again, mixed 
strategies, and all other stochastic actions, are implemented with the aid of a generator. 

• A reward, or payoff, variable Wc,i,g- This variable starts out at in the first round of each 
generation, and its change in each round measures the success of a cell in that round. 
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Changes to the reward variable are determined by a matrix G. This matrix defines the 
game and does not change during its course. That is, if a cellular game has radius r, and i > 1, 



An example of a game matrix is this table for a Prisoner's Dilemma game: That is, if "D" 



is defect, and "C" is cooperate: G[CDC] = 100, G[CDD] = G[DDC] = 70, G[GGG] = 60, 
G[DDD] = 40, G[DCC] = G[CCD] = 30, G[DGD] = 0. For this game, k = 2 (that is, there 



are two possible moves, cooperate or defect); and r = 1 (only the moves of the nearest neighbors 
of a cell affect its reward variable). 

In the Arthur-Packard- Rogers model, a fixed number of rounds R (e.g., 150 rounds), is 
regarded as constituting a generation. After each generation, cell strategies change, as follows: 

• The probability of a cell "living" into the next generation, is an increasing function of the 
size of its reward variable. Usually the reward matrix contains only positive entries, and 
life probability is proportional to the size of the reward variable of a cell. 

• A live cell keeps its strategy in the next generation. 

• A cell that does not live is given a new strategy in the next generation. This strategy is 
chosen as follows: 

• New entries in the strategy table are taken from corresponding entries in either one of the 
two parent cells (the nearest living neighbors of a cell on each side). The new strategy 
table can contain elements from both parent cells {crossover, Definition |2.4| ) or only from 
one parent (no crossover). The exact details of how such a selection is carried is part of 
the genetic algorithm used in the program. For a discussion of genetic algorithms, see 
Q. Note, however, that all such algorithms are symmetric between the left and right 
parent; and that if a cell has no living neighbors on either side, all strategy possibilities 
are equally likely. 

• After the basic new strategy is chosen, each table entry is subject to mutation (Definition 
|2.6| ). That is, there is a small probability it may change. 



Wc,i,g = Wc,i-i,g + G[m, 



'C-r,t,g, 



. . . , Tllc^i g, . . . , nicJ^i'^i^g 
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Figures 
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Figure D.l: Computer simulation of the Stag Hunt, a modified Arthur-Packard- Rogers cel- 
lular game model, with 75 cells, and 150 generations per round. Program cg2.pas, random 
seed 824709136, generation 1. In this program, all initial strategies are depth 1, but strategies 
of depth up to 3 may be introduced as the system evolves. 
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Figure D.2: The same program, parameters, and seed as above, generation 27. Notice the 
rightward-moving waves of cooperative behavior, in the right part of the display. Here some 
zones exhibit cellular automaton-like triangular patterns. 
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Figure D.3: Generation 139 of this run. Cellular automaton-like triangles predominate in this 
figure. 
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Figure D.4: Generation 165. There are now leftward-moving waves of cooperative behavior, 
in the middle of the display. 
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Figure D.5: Generation 305. 
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Figure D.6: Generation 483. Cellular automaton-like triangles appear again. 
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Figure D.7: Generation 560. Move behavior does not appear to have changed much in many 
generations. 
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Figure D.8: Generation 561. An all-cooperate zone appears. The next three figures show 
rapid growth of this zone. 
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Figure D.IO: Generation 658. 
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Figure D.ll: Generation 662. The all-cooperate zone has almost completely taken over the 
ring. 
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Figure D.12: Generation 930. Large all-cooperate zones have predominated in the past several 
hundred generations. However, at this point, a perturbation in strategy - that is, an unexpected 
defect move - can set off many defect moves in other cells. 
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Figure D.13: Generation 982. Recovery of an all-cooperate zone. 
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Figure D.14: Generation 1262. At this point, perturbations do not set off much defecting 
behavior in other cells. That is, strategies are no longer, "Cooperate unless there are defectors 
in the neighborhood," but, "Cooperate, whatever happens." 
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Figure D.15: Computer simulation of a one-round cellular game, the Cloud Process, on a 
ring of 640 cells. The table for this game is: G{BBB) = G{WWW) = 0.27, G{BBW) = 
G{BWB) = G{BWW) = G{WBB) = G{WBW) = G{WWB) = 0.53. Program cloud. pas, 
random seed 118950941. Initial conditions were chosen with the aid of a pseudorandom number 
generator. 
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Figure D.16: Computer simulation of a one-round Prisoner's Dilemma game on a ring of 600 
cells. Initially, two defectors are placed side-by- side; all other cells are cooperators. (Black indi- 
cates defecting cells, and white, cooperating.) Program prisoner .pas, random seed 424479774. 
Note that the rate of expansion of the black domain appears roughly similar on each side, thus 
suggesting an informal estimate of the expected rate. 
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Figure D.17: Computer simulation of a zero-depth, one round per generation Stag Hunt 
game on a ring of 600 cells. Initially, four cooperators are placed contiguously; all other cells 
are defectors. Program stag. pas, random seed 941165838. Note that, in this case, the rate of 
expansion of the white domain appears to vary considerably. 
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Figure D.18: Computer simulation of a zero-depth, one round per generation Stag Hunt 
game on a ring of 600 cells. Initially, four defectors are placed contiguously; all other cells are 
cooperators. Program stag2.pas, random seed 90049811. 
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Figure D.19: Join/mix processes with various parameters. Each process is run on a circular 

lattice of 165 cells for 125 generations. Initially, all cells are white except for cells 48 through 
70, and 95 through 117. The numbers at the bottom show the values of pi; and those on the 
left show the values of p2- That is, both pi and p2 are set at 0.15, 0.50, and 0.85. The program 
used is square. pas, seed 252644401. 
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Figure D.20: Computer simulation of the Join or Die Process on a ring of 640 cells. Initial 

conditions are black for cells through 127, and 512 through 639, and white for cells 128 
through 511. Program jd.pas, random seed 274535429. 
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Figure D.21: Computer simulation of the Join or Die Process. Initial conditions were chosen 
with the aid of a pseudorandom number generator, so each cell is equally likely to be black 
or white. Random seed 705238026 is used; and the same program, and ring size, as in the 
preceding figure. 
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Figure D.22: The annihilating particle model, on a ring of 640 cells, which initially contains 
28 particles. Program apm.pas, seed 269093635. Each particle executes a symmetric random 
walk, having a 50% probability of going either left or right in each generation. 
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Figure D.23: Computer simulation of the Mixing Process on a ring of 640 cells. Initial 

conditions are black for cells through 127, and 512 through 639, and white for cells 128 
through 511. Program mix. pas, random seed 912200719. 
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Abstract 



A cellular game is a dynamical system in which cells, placed in some discrete structure, are 
regarded as playing a game with their immediate neighbors. Individual strategies may be 
either deterministic or stochastic. Strategy success is measured according to some universal 
and unchanging criterion. Successful strategies persist and spread; unsuccessful ones disappear. 

In this thesis, two cellular game models are formally defined, and are compared to cellular 
automata. Computer simulations of these models are presented. 

Conditions providing maximal average cell success, on one and two-dimensional lattices, are 
examined. It is shown that these conditions are not necessarily stable; and an example of such 
instability is analyzed. It is also shown that Nash equilibrium strategies are not necessarily 
stable. 

Finally, a particular kind of zero-depth, two-strategy cellular game is discussed; such a 
game is called a simple cellular game. It is shown that if a simple cellular game is left /right 
symmetric, and if there are initially only finitely many cells using one strategy, the zone in 
which this strategy occurs has probability of expanding arbitrarily far in one direction only. 
With probability 1, it will either expand in both directions or disappear. 

Computer simulations of such games are presented. These experiments suggest the existence 
of two different kinds of asymptotic behavior. 
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Chapter 1 

Introduction 



A cellular game is a dynamical system; that is, the variables it is composed of are regarded as 
changing over time. These variables or cells, arranged in a discrete structure such as a ring, are 
thought of as repeatedly playing a game with their neighbors. Most of this paper is concerned 
with one- dimensional cellular games, defined more formally as follows: 

Definition 1.1 A one-dimensional cellular game consists of: 

1. A one-dimensional discrete structure, uniform from the viewpoint of each site; that is, a 
ring or doubly infinite path. 

2. A variable, or cell, at each site. The components of this variable may change at each 
discrete unit of time, or round. They consist of, at least: 

(a) A move component, which can take on a finite number k of values. 

(b) A strategy component, which determines what move a cell makes in a given round. 
The strategy of a cell is based on past moves of it and its r nearest neighbors on each 
side. The number of past rounds considered is called the depth d of the strategy. 
This r, as used above, is the radius of the game. 

3. A fitness criterion, which does not change and is the same for each cell. This fitness 
criterion is usually local; that is, the fitness of a cell in each round is based on its move, 
and those of nearest neighbors within the radius of the game. 
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4- A mechanism for strategy selection, under which more fit strategies survive and spread. 
Strategy selection is usually nonlocal; that is, a more fit strategy may spread arbitrarily 
far in a fixed number of time units. An interval between strategy changes, which may be 
one or more rounds, is called a generation. 

Thus, a cellular game can be considered a process in which cells make moves each round, 
based on their strategies, and strategies are updated in each generation, based on their fitness 
in preceding rounds. 

Note that cellular game strategies and fitness criteria are usually stored in the form of a 
table. Also note that ra-dimensional cellular automata, with one cell for each ra-tuple of integers 
or integers mod k, can be similarly defined. 

One-dimensional cellular games are studied in [20], [3], [4], and [13]. Similar systems are 
discussed in [10], [11] and [12]; and games on a two-dimensional lattice in [15]. 

Cellular games satisfy a criterion for "artificial life" as discussed by Christopher Langton 
[7]. That is, "There are no rules in the system that dictate global behavior. Any behavior at 
levels higher than the (individual cells) is, therefore, emergent." 

Cellular games are a generalization and extension of another, more well-known, discrete 
dynamical system; that is, of cellular automata. They were created largely because of ques- 
tions arising from the observation of cellular automata. One-dimensional cellular automata are 
defined as follows: 

Definition 1.2 A one-dimensional cellular automaton consists of: 

• A one-dimensional discrete structure, uniform from the viewpoint of each site; that is, a 
ring or doubly infinite path. 

• A variable, or cell, at each site, that can take on finitely many values or states. The 

initial states of a cell may be specified as desired. 

• A function which decides how each cell changes state from one generation, or discrete 
unit of time, to the next. This function, or cellular automaton rule, is always the 
same for each cell, and depends entirely on the state of a cell and that of its r neighbors 
on each side in the past m generations. This r is referred to as the radius of the cellular 
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automaton, and m as its order. Cellular automaton rules are usually stored and described 
in the form of a table. 

It can be shown that a mth-order cellular automaton is equivalent to a first-order cellular 
automaton with more states. This proof [23], however, is dependent on the locality of cellular 
automata - that is, on the fact that cells are directly affected only by their neighbors. For 
similar mathematical objects, such as cellular games, that are not local, this proof cannot be 
used. 

Thus, if a cellular automaton, of radius r, operates on cells that can take k possible states, 
there are k^^'^^ possible circumstances that need to be considered. The rule table, therefore, 
has k^^~^^ entries; and there are k^^"^^^ possible r-radius, A;-state cellular automaton rules. 
An example of a cellular automaton rule is the two-state, radius one rule whose evolution is 
illustrated below. In this rule, a cell can be in either state or state 1. Any cell that, in 
generation g is in state 1, and has both of its neighbors in state 1, stays in state 1 in generation 
^ -|- 1. Otherwise, a cell is in state in generation g -\- 1. This rule is Rule 128 according to 
Wolfram's [24] classification system of the 256 2-state, radius one rules. 

Generation 1: 1 1 1 1 1 1 1 
Generation 2: 0001100000 
Generation 3: 0000000000 

Table 1.3 The action of rule 128 on a circular ring often cells, for three generations. 

Definition 1.4 A stochastic cellular automaton is as above, except that neighborhood 
states do not determine the move made in the next generation, but the probability that a par- 
ticular move will be made. 

Computer experiments on one- dimensional cellular automata are usually conducted with 
cells arranged in a ring. Cell states are indicated by colors; thus, A;-state cellular automaton rules 
are often referred to as A;-color rules. Initial conditions are displayed in a line on top of the screen, 
with each generation being displayed below the previous generation. In such experiments, initial 
conditions, and rule table entries, are often chosen with the aid of a pseudorandom number 
generator. 
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As a matter of fact, descriptions of computer experiments with cellular automata and other 
discrete dynamical systems often make reference, informally, to "random" initial conditions. 
This concept actually applies to mathematical models containing infinitely many variables, 
such as a one- dimensional cellular automaton with one cell for each integer. In such a case, 
"random," "almost all," or "normal" initial conditions refer to conditions such that all of 
the ra-tuples of k cell states are equally likely, for all n. Or, in other words, if the states of the 
cells are construed as decimal places of two real numbers, both numbers are normal to base k. 

Such conditions cannot be exactly duplicated in the finite case, no matter how large the 
number of cells. However, conditions can be created which appear disordered and satisfy certain 
statistical tests of disorder. This is done with the aid of a pseudorandom number generator. 
Such initial conditions are often loosely referred to as "random." Computer simulations of 
discrete dynamical systems often use such initial conditions as the most feasible indicator of 
likely behavior. 

In such experiments, there are, roughly, three types of asymptotic behavior. First of all, all 
cells may become and remain one color, or change color periodically, with a small and easily 
observable period. Second, cells may display "chaotic" behavior; that is, cell color choice may 
appear to be disordered, or to result from some other simple stochastic algorithm. Third, cell 
color choice may be neither periodic nor chaotic, but appear to display organized complexity. 
That is, the cell evolution diagrams may look like biological structures, such as plants, or social 
structures, such as city maps. As a matter of fact, such diagrams are often quite esthetically 
pleasing. These rule types are discussed in [25]; for more on the concept of "complexity," as it 
applies to cellular automaton rules, see [22]. 

On a finite ring of cells, of course, all such evolution is eventually periodic. But, if cells can 
be in 2 states, and there are 640 cells, there are 2^"*° possible ring states. Therefore the period 
of ring states could, conceivably, be quite high; and "chaotic" or "complex" rules do indeed 
seem to have very high periods. 

Visual representations of cellular automata can exhibit a sophistication reminiscent of living 
structures. However, the number of A;-state, r-radius cellular automaton rules is very large 
(k ) for all but the smallest k and r; and "interesting" rules are not common and difficult to 
find. This leads to the question, therefore, of whether there is some way of "evolving" cellular 
automaton rules in a desired direction. 
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There are two possible avenues of approach to this question. One is to select rules based 
on their global properties. That is, some computable measure of the desired characteristics is 
devised, and rules are chosen by their ability to meet this measure. Such selections are discussed 
in [17] and [14]. 

The other way is to select rules based on their local properties. That is, each cell uses 
a different rule; and there is some universal and unchanging criterion for rule success. This 
approach is more like the way living systems evolve, for the evolution of a planetary ecology is 
not due to constraints placed directly on the ecology. It is an emergent property of constraints 
placed on the individual organisms. For this reason, such models may potentially reveal not 
only the nature of "complex" rules, but also how their global properties emerge from local 
interactions. 

An evolutionary model of this sort is equivalent to a cellular game; the only difference is 
the terminology. That is, the strategy of a cell can be regarded as the individual rule used by 
each cell; the depth of the strategy as the order of the rule; cell moves as states; and instead of 
referring to the smallest unit of time as a round, and a possibly larger unit as a generation, the 
smallest unit can, as with cellular automata, be referred to as a generation. The fitness criteria 
and evolutionary process stay the same. 

A cellular game differs from a cellular automaton not only in the precise definition used, 
but also in the philosophy under which this definition was constructed. That is: 

• Cellular automata are often regarded as a physical models; for example, each cell may 
be seen as an individual atom. Thus, the rules by which each cell operates are the same. 
Cellular games, on the other hand, are seen as an evolutionary models. Each cell uses an 
individual rule, or strategy, which can be thought of as the "genetic code" of the cell. 

• Cellular automata are usually thought of as deterministic, beyond the initial genera- 
tion, though stochastic cellular automata have also been studied. Cellular games operate 
stochastically; that is, the evolutionary process under which strategies are modified is 
stochastic, and, often, the strategies themselves are stochastic. 

• Cellular automata are local; that is, the state of a cell is affected only by the states of its r 
nearest neighbors on each side in the previous generation. In other words, cell information 
cannot travel more than r units per generation. This speed is often called "the speed of 
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light." Cellular games, on the other hand, typically use nonlocal strategy selection criteria. 
That is, a more fit strategy may propagate arbitrarily far in one generation. (There is 
more discussion of the nonlocality of cellular games in Section 2.4.) 

• In [23], it is shown that mth-order cellular automata are behaviorally equivalent to first- 
order cellular automata with larger radius and more states. However, this proof does 
not work for cellular games with nonlocal selection criteria. Moreover, cellular games are 
often constructed with strategies looking more than one generation back. 

Now, it can be shown that if a cellular game has a local fitness criterion and local rule 
selection process, it is actually equivalent to a cellular automaton with a large number of 
states. This automaton, of course, will be stochastic if the game is stochastic. 

Theorem 1.5 Let G be a cellular game with a local fitness criterion and local rule selection 
process, which operates every R rounds. Let all fitness measurements start over again after this 
process. Then G is equivalent to a cellular automaton G' with a much larger number of states. 

Proof. Let G' be constructed as follows: let the state of a cell c in G' be a vector with the 
following components: 

1. The state of c in G. 

2. The individual rule used by c, in G. 

3. A i?-valued counting variable, which starts out as 1 in the first generation, and thereafter 
corresponds to the current generation mod R. 

4. A fitness variable, which corresponds to the accumulated fitness of a cell over R rounds. 

Since these components enable G' to simulate the action of G, it suffices to show that G' is 
a cellular automaton. That is, each component must have only finitely many possible values, 
and be locally determined. This is shown to be true for each component, as follows: 

1. By definition of G, the first component has only finitely many values. It is determined by 
the rule of a cell, and the states of it and its neighbors in preceding rounds. 
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2. By definition 1.1, even if stochastic rules are used only finitely many are considered. 
Whether or not a cell keeps its rule, after R rounds, is based on its own fitness, and the 
process of selecting new rules is assumed to be local. 

3. The counting component can be in any one of R different states. The rule for its change 
is simple: If it is in state s in round d, it is in state s + 1 mod g in round d + 1. Note 
that to run G' as a simulation of G, this counting component must be initially set at the 
same value for all cells. 

4. The fitness component is set to zero after every R rounds; and can be incremented or 
decremented in only finitely many different ways. How it changes in each generation, for 
a given cell c, depends on the first components of cells c — r through c + r. 

I 

Given this equivalence, why, then, is a cellular game so different from a cellular automaton? 
For one thing, cellular games often do use a nonlocal strategy selection process; it may be 
considered an approximation to a selection process that can operate over very large distances. 
For another, cellular automaton rule spaces, especially those with high radius, typically contain 
very large numbers of rules. Therefore, even if only systems with a local selection process are 
considered, the evolutionary paradigm of cellular games may still be valuable. It may be a 
practical method of selecting members of these spaces with interesting properties. 

In this paper, two different models of cellular games are defined. The original Arthur- 
Packard- Rogers model is discussed first in Section 2.2. This model is quite extensive and uses 
many different parameters. The second, simplified, model is more amenable to mathematical 
analysis. This model is discussed in Section 2.4. 

Computer simulations of both models are presented. These simulations are similar to those 
of cellular automata, both in the way they are conducted and in the way they are displayed. 
That is, cell moves are indicated by colors. Strategies are usually not pictured, due to the large 
size of strategy spaces. Thus, the move of a cell may also be referred to as its color. Initial 
moves of a finite ring of cells are displayed in a line on top of the screen, and each generation is 
displayed below the previous generation. Initial moves and strategies, as well as other stochastic 
choices during the course of the game, are implemented with the aid of a pseudorandom number 
generator. 
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Computer simulations of the first model display sophisticated behavior reminiscent of living 
systems, or "complicated" cellular automata. These behaviors, which include such phenomena 
as zone growth and "punctuated equilibria," are discussed and extensively illustrated in Section 
2.3. 

The second model admits only deterministic strategies of depth zero; that is, strategies 
of the form, "Do move m, without regard to previous rounds." Thus, in this model, moves 
and strategies can be considered equivalent. Though this model is simpler, there are still 
counterintuitive results associated with it. Even if only two strategies are allowed under this 
model, it is extremely difficult to predict which, if either, will be stable under invasion by the 
other. There are no simple algorithms for determining this. 

For example, consider ring viability, discussed in Section 2.5. For finite rings this concept. 
Definition 2.10, refers to the average success of all cells in the ring. In this chapter, it is shown 
that under any local fitness criterion G, rings in which the cells have made periodic move 
sequences have the highest possible viability. It is also shown that a similar result is false in 
the two-dimensional case. 

Now, if cellular games did indeed always evolve towards highest ring viability, this would 
make their course relatively easy to predict. However, in Section 2.6, a two-strategy cellular 
game is presented, in which the best strategy for the ring as a whole - that is, the strategy that, 
if every cell follows it, maximizes ring viability - is not stable under invasion. This instability is 
illustrated by computer simulations, and is also proved. This is done by showing that if a small 
number of cells using the invading strategy are surrounded by large numbers that are not, the 
invading strategy tends to spread in the next generation. The reason for this is that the first 
strategy, though it does well against itself, does poorly against the second one. 

On the other hand, a winning strategy may not necessarily be stable either. That is, strategy 
A may defeat strategy B, but still be unable to resist invasion by it. The reason, in this case, 
is that strategy B does so much better against itself. This result can also be demonstrated by 
computer simulations and proved, using the same method. These results are also in Section 
2.6. 

Finally, consider a situation in which, if its neighbors use strategy A, a cell has greatest 
success if it uses strategy A too. It seems logical that, in this case, strategy A would indeed 



8 



be stable. As a matter of fact, such a situation is called, in game theory, a symmetric Nash 
equilibrium. 

However, it can be demonstrated by computer simulations, and also proved, that some 
symmetric Nash equilibrium strategies are not stable under invasion. The reason, in such cases, 
is that strategy B has somewhat less probability of surviving in a strategy A environment, but 
is very good at causing strategy A not to survive. Therefore strategy B is somewhat less likely 
to persist, but is a lot more likely to spread. This result is also considered in Section 2.6. 

Thus, the three theorems in Section 2.6 show how difficult it is to predict the course of 
cellular games, even under a very simple model. The counterintuitive nature of the results 
obtained suggests the potential mathematical interest of this paradigm. 

The second part of this thesis presents results applicable to particular examples of the zero- 
depth model, called simple cellular games. These games have two distinguishing characteristics: 

• There are only two possible strategies; these two strategies are referred to as white, and 
black. 

• Each cell has, at all times, positive probability of either living or not living. 

The theorems discussed in the second part apply to simple cellular games which are left /right 
symmetric. The Double Glider Theorem, 3.14, applies to the evolution of such games under 
initial conditions under which there are only finitely many black cells. The zone of uncertainty 
is defined as the zone between the leftmost and rightmost black cell. It is shown that the 
probability this zone will expand arbitrarily far in one direction only is 0. That is, with 
probability 1, it will either expand in both directions or disappear. 

Section 3.3, which follows, discusses simple game evolution in a slightly different con- 
text; that is, under conditions such that there is a leftmost white cell and a rightmost black 
cell, or standard restricted initial conditions. Simple cellular games with both left/right and 
black/ white symmetry are classified according to their asymptotic behavior under these circum- 
stances. That is, they are divided into mixing processes and clumping processes. The behavior 
of clumping processes is further explored, and a conjecture is made that applies to both kinds 
of processes. 
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In Section 3.4, the last chapter, specific examples of simple cellular games are presented. 
Computer simulations suggest that one of these examples, the Join or Die Process, is a clumping 
process; and the other, the Mixing Process, is, as named, a mixing process. 
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Chapter 2 



Cellular Game Models 

2.1 Game Theory and Cellular Games 

Success criteria in tabular form, or score tables, are extensively used in game theory. They 
describe the course of any game which can be exactly modelled, for which strategy success can 
be numerically described, and in which all strategies are based on finite, exact information. 
For example, consider the game of Scissors, Paper, Stone; that is. Scissors beats Paper, Paper 
beats Stone, and Stone beats Scissors. Suppose this game is played for one round, and the only 
possible strategies are deterministic. Then the table for this game is (if a win scores 1, tie at .5 
and loss at 0): 



Opponent 


Scissors 


Paper 


St. 


Player 








Scissors 


.5 


1 





Paper 





.5 


1 


Stone 


1 





.5 



The following definition is used in game theory: 

Definition 2.1 A mixed strategy is a stochastic strategy; that is, one under which, in some 
specified circumstances, more than one move has positive probability. 
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A table can also be devised for mixed strategies, and for games of more than one round. 
For mixed strategies the table entry describes the expected success. 

For example, suppose the game of Scissors, Paper Stone is played for two rounds, and there 
are three possible strategies. Strategy A is to choose each move with probability ^, Strategy B 
is to choose Stone for the first move, and the move chosen by the other player for the second, 
and Strategy C is always to choose Paper. Then the table for this game is: 

Opponent Strategy A Strategy B Strategy C 



Player 

Strategy A 1 1 1 

Strategy B 1 1 .5 

Strategy CI 1.5 1 



Definition 2.2 A table depicting strategy success as described above is called the normal form 
of a game. 

Normal form can be used, at least theoretically, to describe extremely sophisticated games. 
For example, if only a fixed finite number of moves are allowed, and strategies consider only 
the history of the current game, then there are only finitely many deterministic strategies for 
the game of chess. Hence normal form could, at least theoretically, be used to describe this 
game. Of course, there are so many possible chess strategies that this form cannot be used for 
practical purposes. For more on normal form, see [9]. 

Note that this form is ambiguous if mixed strategies are allowed. For example, consider 
the above table. Does it indicate the actual success levels of deterministic strategies, or the 
expected success levels of stochastic ones? It is not possible to tell without further information. 

Such a normal form can also be used to describe three-player games. For example, this 
table describes a game in which there are two moves, you score .85 if you make the same move 
as both other players and .15 otherwise. This game is called the Join or Die game. 

Your Move: B Your Move: W 
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Player 1: 

Player 2: 

B 

W 



B W 



.85 .15 
.15 .15 



Player 1: 

Player 2: 

B 

W 



B W 



.15 .15 
.15 .85 



Now, consider cellular games. If the success criterion, or score, is local; that is, if it is based 
entirely on the state of a cell and those of its neighbors, it can also be encoded as a table. As 
a matter of fact, any game table for 2r + 1 players can be used as the score table for a cellular 
game of radius r. For example, the Join or Die process is a cellular game of radius 1, in which 
each cell plays the Join or Die game with its two nearest neighbors. The following table is used 
for this process: 



Cell's Move: 



B 



Cell's Move: 



W 



Right Neighbor: B W 



Right Neighbor: B W 



Left Neighbor: 

B .85 .15 

W .15 .15 



Left Neighbor: 

B .15 .15 

W .15 .85 



However, cellular games differ from the situations most analyzed by game theorists, or the 
vernacular notion of a game, in the following ways: 

• Each cell interacts with different neighbors, as determined by the discrete structure on 
which the cellular game is run. That is, the score of cell is based on its move, and those 
of cells 1 and —1. The score of cell 1 is based on the moves of cells and 2, not cells 
and —1. 

• The "game" is considered to be played repeatedly, for many rounds. Thus, the main focus 
is on optimal move behavior in the long run, not for one round only. 
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• There is an explicit mechanism for determining how successful strategies thrive and 
spread. The cellular game is not completely described without this mechanism; no as- 
sumptions about asymptotic behavior can be made just on the basis of the score table. 

2.2 The Arthur- Packard- Rogers Model 

The idea of cellular games was first developed by Norman Packard and Brian Arthur at the Santa 
Fe Institute [16]; and first written up by K. C. Rogers, in a Master's thesis at the University of 
Illinois under the direction of Dr. Packard [20]. In this model, cells arranged in a ring play a 
game, such as the well-known Prisoner's Dilemma, with each of their nearest neighbors. They 
play for a fixed number of rounds. At the end of these rounds, or of a generation, strategies may 
change. Successful strategies are most likely to spread and persist. The Prisoner's Dilemma is 
discussed in [18], [1] and Appendix B. 

For details of this model, see Appendix C. The terms used are described in Definition 1.1. 

The Arthur-Packard- Rogers model can be summarized as follows: Cells, arranged in a one- 
dimensional structure, play a game, such as the Prisoner's Dilemma, with their neighbors, for 
a predetermined number of rounds. The criteria for success in each round do not change, and 
are the same for each cell. Since the degree of success is based only on the moves of a cell and 
those of its r nearest neighbors on each side, this criterion can be encoded in the form of a 
table. 

The strategies that govern cell move choices may be different for each cell, may be deter- 
ministic or stochastic, are based on past move history, and are stored in the form of a table. 
Strategies may have depth zero, one, or more. 

At the end of these rounds - that is, at the end of a generation - the probability that a 
cell keeps its strategy in the next generation is proportional to the size of its reward variable, 
which measures its success in the game. 

Definition 2.3 Cell death; A cell is said to die if its strategy is deemed replaceable; that is, 
it is thought of as unsuccessful. The replacing strategy is usually derived from the strategies of 
other cells. 
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Finally, if a cell dies at the end of a generation, the strategy chosen is some combination of 
the strategies of its nearest living neighbors. If it contains elements of both neighbors, crossover 
is said to occur. 

Definition 2.4 Crossover is the existence, in a new strategy, of behavior similar to more than 
one "parent" strategy. 

Definition 2.5 Those cells whose strategies contribute to the new strategy of a cell are called 
its parents. 

There may also be a small probability of strategy table mutation. 

Definition 2.6 A mutation is said to occur when, after a strategy table entry has been chosen 
from a parent cell, it is arbitrarily changed. 

In computer simulations, this is often done with the aid of a pseudorandom number gener- 
ator. 

This model is not quite the same as the original one used in [20]. In that construction, 
strategy replacement was not governed by locality; that is, parent cells were the most successful 
in the ring. Thus, the progenitor of the strategy of a cell was not particularly likely to be nearby. 

In this model, however, parent cells are not necessarily the most successful cells in the ring. 
Instead, they are the nearest living neighbors of a cell. Such a model is more comparable with 
living systems, because it bases system evolution more completely on local properties. It is also 
more easily generalizable to the infinite case, in which there is one cell for each integer. And it 
is only under such a model that one can see the evolution of zones of different strategies. 

2.3 Computer Experiments 

The Arthur-Packard- Rogers model has been simulated in computer experiments, with the aid 
of a pseudorandom number generator. Cell moves are displayed onscreen, in a form similar 
to the display of cellular automaton states. That is, initial moves, for each generation, are 
shown in a line on top of the screen; and moves for each round are shown below the preceding 
round. In experiments simulating the Prisoner's Dilemma, or variations, lighter areas indicate 
cooperative moves; dark areas, defecting moves. In particular, in the games illustrated in the 
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accompanying figures, all strategies are mixed, or stochastic. That is, there is always at least a 
small probability that a move is made other than the one called for by the strategy. 

The experiment illustrated in Figures 1 through 14 simulates a variation of the Prisoner's 
Dilemma, the Stag Hunt. The Stag Hunt is modeled on the dilemma of a member of a pack of 
hunting animals, such as wolves or coyotes. If the whole pack hunts together, they can bring 
down a stag, which is the highest reward. If a member defects, it will be able to get a rabbit 
alone. If the other animals do not defect, they will have a smaller chance of bringing down a 
stag, but it may still be possible; but it is very unlikely that one animal can bring down a stag 
all by itself. Thus, the highest expected reward is for mutual cooperation; next highest, for 
defecting while the other members of the pack cooperate; next, for mutual defection, and fourth, 
for cooperating while the other members of the pack defect. See [18] for more information on 
the Stag Hunt; and Appendix A for a more technical discussion of the experiments. 

These computer experiments fully suggest the mathematical interest of the subject. They 
reveal thought-provoking behavior, such as: 

• Zone growth. Strategies may not evolve in the same manner in all areas of the ring. 
Zones of cooperative, defecting or other consistent behavior may arise and persist for 
generations. 

• Periodic structures. Cells may alternate between cooperation and defection, or waves of 
cooperation may spread through some or all zones of the ring. 

• "Complexity." Move patterns may display a sophistication reminiscent of living struc- 
tures, or the patterns found in "complex" cellular automata. 

• Long transients. Strategies predominant for hundreds of generations may ultimately dis- 
appear, and be replaced by completely different behavior. 

• "Punctuated equilibria." Move behavior that appears to be stable for many generations 
may, suddenly, change very quickly - and then become stable again, for a long time. 

Note that cellular games cannot be construed to represent any particular living systems, 
social or biological. For one thing, their behavior changes very easily as parameters are mod- 
ified; it is difficult to tell which features are essential, or appropriate to any particular model. 
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However, the existence of the above characteristics suggests that cellular games are evocative 
of biological evolution. It seems possible that the two will turn out to have some features in 
common. 

2.4 The Zero-Depth Model 

Now, these experiments well suggest the richness of behavior cellular games offer. The sophis- 
tication of patterns displayed provides ample justification for further study of this paradigm. 
But the Arthur-Packard- Rogers model does not lend itself well to mathematical analysis. Its 
computer implementation is lengthy and contains many modifiable parameters. It is difficult 
to decide if any behavior exhibited is general, or just an artifact of the specific algorithms used. 

To facilitate mathematical discussion of cellular game behavior, it is hence appropriate 
to simplify the model. Extensive study has been performed on such a model, exhibiting the 
following simplifications: 

• Elimination of crossover. The Arthur-Packard- Rogers model allows crossover. (Definition 
2.4.) 

In the simplified model, crossover is eliminated, and each new strategy is an exact copy 
of one that already exists. A rationale for this simplification, in terms of living systems, 
is that one is considering the evolution of a specific gene, which spreads on an either-or 
basis. However, a particular gene may be significant only in the context of other factors. 
It may thus not be appropriate to consider this gene on its own. Note that computer 
experiments using genetic algorithms reinforce the significance of crossover (see [8]). 

• Elimination of mutation. Another simplification is the elimination of mutation (Definition 
2.6). That is, after the initial round, any strategy is new for a specific cell only, and is 
a copy of the strategy used by an existing cell. Particularly without crossover, this 
elimination is actually likely to change the long-term behavior of the system. For example, 
suppose strategy A is successful against all other strategies, including itself. If a ring of 
cells is originally free of strategy A, but mutation is allowed, strategy A will eventually 
take over the ring. If there is no mutation, the ring will stay free of it. However, the 
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behavior of a cellular game that allows mutation may best be understood in terms of, and 
in comparison to, the behavior of the simpler system. 

• One round per generation. That is, cell strategy may change after each round of play. 

• Elimination of mixed strategies. Strategies are deterministic, not stochastic. 

• Elimination of depth. The final simplification is the elimination of depth. That is, all 
strategies are executed without regard to past moves. Since there are no mixed strate- 
gies, the strategy, then, just becomes "do move m," and the move variable can thus be 
eliminated from the description of the game. 

The question of how depth and round restrictions affect cellular game behavior is a subject 
for future research; however, these restrictions are not as severe as they seem. From game 
theory, we learn that all information about games with extremely sophisticated strategies can 
be conveyed in table form; that is, the "normal" form of a game. The only restriction is that 
strategies must take into account only a finite amount of information; e.g., the course of the 
game, but not anything before or beyond. As previously discussed, such tables can be used as 
the score table for a cellular game; in particular, for a zero-depth, one round per generation 
cellular game. 

As a matter of fact, cellular games of many rounds per generation, and with high-depth 
strategies, can be rewritten as zero-depth one round games - if all strategies take into account 
the current generation only. 

Note that the Arthur-Packard- Rogers model, discussed above, does take into account moves 
in the previous generation. However, it could easily be modified not to do so, by providing 
table entries to use when there is limited information about previous rounds. For example, 
there could be an entry for the move used if nothing is known about previous moves. 

Theorem 2.7 Let G be a cellular game of radius r, with R rounds per generation, and strategies 
of depth d - except that all strategies take into account only moves in the current generation. 
Then the action of G can he exactly simulated by a cellular game G' of zero depth and one 
round per generation. 
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Proof. It suffices to sliow tliat for every sucli game G tliere is a zero-deptli, one round cellular 
game G", and a mapping / from strategies in G to strategies in G", such that life probabilities 
correspond. Actions made after cell survival is decided can be the same in each case. 

That is, suppose there are two rings of k cells each, 1 < A; < oo. Let the first ring run G in 
generation g, and let each cell c use strategy Sc- Let the second ring run G' in that generation, 
and let each cell c' use strategy f(Sc)- Then the probability, at the beginning of g, that c 
survives into the next generation should be the same as the probability that c' does. 

To show that such an / can be constructed, it suffices to show that the probability that, 
under G, at the beginning of a generation, that a cell will live through to the next generation 
is entirely dependent on its strategy, and those of its (R — l)r nearest neighbors on each side. 
For if this is true, a table can be constructed, giving the life probability for cell c if it and 
its neighbors follow strategies Sc-(R-i)rj • • • ? Sc, ■ ■ ■ , and this table can be used to 

create a zero-depth, one round cellular game with corresponding life probabilities. 

Now life probabilities in G, at the end of a generation, are entirely dependent on the move 
histories of that generation. Therefore, to show such strategy dependence, it is only necessary 
to show that the probability, at the beginning of g, that cell c will make move m in generation 
q, is entirely dependent on the strategies of c and those of its (q — l)r neighbors on each side. 

This is trivially true in the first round of a generation. Since a cell has no information about 
past moves, the probability it makes move m is entirely dependent on its own strategy. 

Now, suppose this is true for the first q — 1 rounds. In round q, the probability a cell makes 
move m is entirely dependent on its strategy, and the moves made by it and its r neighbors 
on each side, in preceding rounds of this generation. Therefore, by the induction hypothesis, 
this probability at the beginning of a generation is entirely dependent on the strategies of the 
(q — 2)r neighbors of these cells - cells c — (q — l)r through c + (g — l)r. I 

We are thus left with the following model, in which, associated with each cell c, in each 
generation g, are: 

• A move/strategy variable rric^g from some finite alphabet T, of k characters. 

• A binary- valued life variable Lc^g. This variable can be set to either living, or not living. 

In each generation, cell strategies change, as follows: 
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• The probability that the life variable of a cell is set to 1, so that it "lives" into the next 
generation, is determined by a universal and unchanging game matrix G. That probability 
is based on the move/strategies of a cell and those of its r nearest neighbors on each side, 
in that generation. 

• A live cell keeps its strategy in the next generation. 

• A cell that does not live is given a new strategy in the next generation. This strategy is 
either that of its living nearest neighbor to the left, or to the right, with a 50% probability 
of each. If there are no living neighbors to either side, all possible strategies are equally 
likely. 

Note that, in this model, exactly two decisions are made in a generation; first, decisions 
about cell life or death; and second, decisions, for dead cells, of color in the next generation. 

This model lends itself easily to computer simulation, with the different strategies repre- 
sented by different colors. Thus, in descriptions of this model, "move," "strategy," and "color" 
are equivalent. Such a simulation is presented at the end of this paper, in Figure D.15. In this 
simulation, a cell has probability 0.27 of living if it is the same color as both of its neighbors 
and 0.53 otherwise. Due to the shapes of the space-time zones produced, this process is called 
the Cloud Process. The Cloud Process is an example of a join/mix cellular game, as discussed 
in Section 3.4. 

We now discuss a theorem pertinent to this model; that is, a simple characterization of 
identity games. An identity game is a game in which, outside of certain pathological cases, no 
cell can change color. To avoid complications arising from these cases, the identity game is 
formally defined as follows: 

Definition 2.8 The identity game is a game in which, under at least some circumstances, 
cells have positive probability of living; and in which no cell can change strategy, unless there 
are no living cells either to the left or right of it. 

The characterization is: 

Theorem 2.9 Under the zero-depth model, a cellular game is the identity game if and only if 
the probability that a cell stays alive, if its strategy is different from at least one of its neighbors, 
is 1. 
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Proof. Suppose a G is a zero-depth cellular game of radius r, with life probabilities fitting 
the above description. Suppose a cell has living neighbors on each side. Then either: 

1. A cell is not the same color/strategy as both of its neighbors. Then it will stay alive. 

2. A cell c is the same color as both of its neighbors, but has neighbors on both sides of 
different colors, the nearest ones being cells c — ri on the left and c + r2 on the right. 
Then cells c — ri + 1 and c + r2 — 1 are alive. Therefore, if c dies, the left parent of c will 
be cell c — ri + 1, or a cell closer to c; and the right parent of c will be cell c + r2 — 1, or 
a cell closer to c. Thus if c dies, both parents will be the same color as c. 

On the other hand, suppose G is such that there is positive probability a cell ci of color a, 
next to a cell C2 of color 5, may not live. Let there be a configuration of cells giving positive life 
probability to the center cell. Thus, since life probabilities are determined locally, it is possible 
that there may be living cells on either side of ci. Let ci die, and let it have living neighbors 
on each side. If either of these neighbors is not the same color as ci, then ci may change color; 
if both are, C2 will change color. I 

Finally, if cellular games, as described above, are intended to model living systems, two 
questions arise. First, why is a new strategy a symmetric function of the strategies of both 
parents, instead of, for example, being more infiuenced by the strategy of the nearest parent? 

One answer is that this process is intended to model sexual reproduction, in which a gene has 
an equal possibility of coming from each parent. Another is that if there is positive probability 
that each gene comes from each parent, the model may actually not behave very differently. 
Future research may settle this question. 

The second question is, why nonlocality? That is, why not say that if a cell has no living 
neighbors near enough, it just stays dead in the succeeding generation? In this case, comparison 
with living ecosystems does suggest that locality is more appropriate, but with a very large 
radius. That is, suppose there is a large die-off of organisms in one particular area. Then 
organisms from surrounding areas will rush in very fast, to fill the vacant area - but they 
cannot rush in infinitely far in one generation. Once again, future research may settle whether 
the simplified assumption, that is, nonlocality, actually creates different long-term behavior. 
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2.5 Ring and Torus Viability 

The following theorem describes move behavior which results in optimal cell viability, for a 
whole ring of cells. It applies to all cellular games with a local life probability matrix; that is, 
all games in which the probability a cell "lives" into the next generation is determined by its 
moves, and those of its neighbors less than a given number r of units away. It thus applies 
to the Arthur-Packard- Rogers model. However, it is here described in terms of the one-round 
model given in the previous chapter. 

Definition 2.10 The ring viability of a finite ring of cells C running a one-round game G, 
in generation g, is the average life probability of these cells in that generation after moves are 
made, but before the life variables of the cells are actually set. 

Since C has finitely many cells, whose moves are from a specific finite alphabet, there is 
some combination of moves which will maximize this viability. For example, in a one-round 
version of the Stag Hunt game, ring viability will be maximized if all cells cooperate; and, 
in some versions of the Prisoner's Dilemma, ring viability will be maximized if cells alternate 
between cooperation and defection. 

The result obtained is that this optimal arrangement is periodic. The following lemma is 
used in proving this: 

Lemma 2.11 Let G be a one-round cellular game of radius r, in which there are k possible 
moves from some finite alphabet S. Let t be any string in S*. Let L(t) be the average life 
probability of all cells in a ring of \t\ cells, such that the move of the ith cell is the ith character 
oft. Then, ifb, wi, W2 are strings in T,* , \b\ > 2r, then we have 

L{bw,bw,) = L{bm) + L{bw^) (2.1) 

Proof. Consider a ring of cells making consecutively the moves in bwibw2. Cells making 
moves from wi are more than r units away from cells making moves from W2. Therefore, these 
cells cannot infiuence each other's life probabilities. In the same way, b is large enough so the 
life probabilities of cells making moves in either copy of b can be infiuenced by cells making 
moves in wi, or in W2, but not by both. Therefore the average life probability of all cells is the 
same as if they were considered to be in two different rings. I 
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The main result follows: 



Theorem 2.12 Let G be a one-round cellular game as above. Then there is some m > and 
some sequence t of m moves, such that rings of nm cells, in which the moves of t are repeated 
n times, have the maximum ring viability, under G, for finite rings of any size. 

Proof. There are only a finite number of strings in S* that either contain no more than 4r 
letters, or, when circularly arranged, no duplicate, nonoverlapping 2r-tuples. Let such strings 
be called "good"; and let t be any "good" string that maximizes L(t). We wish to show that 

L{t) = mj,xL{s) (2.2) 

because, then, rings repeating the moves of t one or more times would have maximal viability. 

Now, this is trivially true for s such that |s| < 2r, because all such s are good. Suppose it 
is true for all s such that |s| < n. We wish to show that it is true for s, such that |s| = n. 

If s is good, this is trivially true. Suppose s is not good. Then we have s = Wibw2b, \wi\, 
1^2! > 0, |5| = 2r. Lemma 2.11 shows that 

L(w,bw,b) = ^(^1^) + ^(^26) ^2.3) 

And, by our induction hypothesis, we know that L(wib) < L(t) and L(w2b) < L(t). I 
A corollary to this theorem is concerned with asymptotic viability of doubly infinite arrays 
of cells. 

Definition 2.13 Let 1(c) be the life probability of a cell c, given its move and those of its r 
neighbors on each side. 

Definition 2.14 Let the asymptotic viability L(L), of a doubly infinite array of cells L, be 
measured as follows: 

i(/) = limsupS^^ (2.4) 

CoroUary 2.15 Let L be a doubly infinite array of cells. Then if t is that finite string that 
maximizes L(t), L(L) cannot be greater than L(t). 
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Proof. Consider what life probability cells n through —n would have if they were arranged 
in a ring, instead of part of a doubly infinite lattice. The only cells that might have different 
life probability are cells —n through —n + r— 1 and n through n — r + 1. And as n becomes 
larger, the contribution of these 2r cells to ring viability goes to 0. I 

In the two-dimensional case, however, a result similar to Theorem 2.12 is false. That is, 
there are two-dimensional cellular games, for which no finite torus can achieve maximal torus 
viability. This is not shown directly, but is a corollary of results about Wang tiles. 

A Wang tile is a square tile with a specific color on each side. A set of Wang tiles is a finite 
number of such tiles, along with rules for which colors can match. For example, a red edge may 
be put next to a blue edge, but not a white edge. Such a set is said to tile the plane, if the 
entire plane can be covered by copies of tiles in the set, so that all edge matchings follow the 
rules. Robert Berger [2] showed that there is a set of Wang tiles that can tile the plane, but 
permit no periodic tiling. Raphael Robinson [19] subsequently discovered another, smaller and 
simpler set of tiles that does the same thing. 

Note that the set of tiles described by Robinson admits an "almost periodic" tiling. That 
is, for any positive integer A, the plane can be covered with these tiles periodically so that, 
under the given rules, the proportion of tiles having unmatching edges is less than jj. 

A two-dimensional cellular game can be made from a k- colored set of Wang tiles as follows: 
Let a cell be considered a tile; let there be k"^ possible moves, and let these moves be considered 
direct products of the colors of the Wang tiles. Let the life probability of a cell be increased 
by I for every match of a component of its move, with the corresponding component of the 
move of its neighbor. For example, | would be added to the life probability of a cell, if the left 
component of its move were compatible to the right component of the move of its left neighbor. 

Suppose a cellular game were made, in this manner, from the set of tiles described by 
Robinson. Then no torus could have viability one, because otherwise there would be a periodic 
tiling of the plane using these tiles. However, there are periodic tilings of the plane for which 
only an arbitrarily small proportion of the tiles have unmatching edges. Therefore, since a 
periodic tiling of the plane can be considered a tiling of a torus, there are torus tilings having 
viability 1 — e, for any e > 0. 

The comparison of cellular games and Wang tilings suggests other possibilities for future 
research on tilings. For example, instead of a Wang tiling in which two colors either match or 
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not, one could consider a tiling in which two colors can partially match. This would correspond 
to a cellular game in which more than two different levels of success were possible. 

2.6 Strategy Stability 

In the preceding chapter, the concept of ring viability was discussed. That is, for each cellular 
game, there is some periodic combination of moves which maximizes average cell viability. One 
might assume that all cellular games would stabilize with cells exhibiting, or mostly exhibiting, 
such a combination of moves. If this assumption were true, questions about the long-term 
evolution of cellular games could be trivially resolved. 

However, computer experiments suggest that this is not necessarily the case. That is, a 
one-round cellular game is simulated in which each cell plays the Prisoner's Dilemma with each 
of its neighbors. Specifications are: 

• Radius. The game is of radius one. 

• Strategies. There are two strategies, or colors: "C," cooperate, or white, and "D," defect, 
or black. 

• Game Table. The game life probability table is: G(CDC) = 1, G(CDD) = G(DDC) = 
^, G{CCC) = ^, G{DDD) = ^, G{CCD) = G{DCC) = ^, G{DCD) = 0. 

{G{mim2m'i) is the probability of a cell surviving, if the move of its right neighbor is mi, 
its own move is m2, and the move of its left neighbor is ms.) 

Under these circumstances, maximal ring viability is achieved by a ring of all-cooperating 
cells. And yet, computer experiments simulating this game do not show the mostly cooperative 
state to be stable. In the simulation depicted in Figure D.16, a small number of defecting cells 
are put in the middle of a large ring of cooperators. The defecting strategy quickly takes over 
the ring. 

The reason for this is that, although defectors do badly against each other, they do extremely 
well against cooperators. Thus, if a small zone of defecting cells is placed in a large ring of 
cooperating cells, the area between the leftmost and rightmost defecting cells tends to expand. 

To address such questions more formally, we use the concept of a domain: 
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Definition 2.16 A domain is a contiguous row of same-colored cells. 

We would like to examine what happens when a small defecting domain is placed between 
two very large cooperating domains. Is the number of defecting cells in the vicinity of that 
domain likely to go up, or down? If it is more likely to go up, we can reasonably say that 
cooperative behavior is not stable under invasion. 

Of course, conceivably, each strategy could be unstable under invasion by the other; that 
is, there could be a tendency for large domains of each color to break up into smaller ones. 

Let there be a doubly infinite lattice of cells, running the Prisoner's Dilemma game described 
above. Let i? be a small, but greater than one-cell, black domain in this lattice, bordered, in 
generation 1, by two large white domains Wi and Wr- Let \B\ be the number of black cells 
in B in generation 0. Let SB equal the number of cells that were white in generation 1, and, 
in generation 2, have black strategies descended from the strategies of cells m B - minus the 
number of cells that were in B in generation 1, and are white in generation 1. Thus, SB is, 
roughly, the change in the number of black cells in the vicinity of B in the next generation. 
Finally, let ci be the rightmost member of Wi, C2 the leftmost member of B, C3 the rightmost 
member of B, and C4 the leftmost member of Wr, in generation 1. 

Now, two terms used in the theorems presented in this chapter are defined. 

Definition 2.17 Let a black incursion be a situation in which a black cell c, in D, becomes 
in the next generation the parent of newly black cells in Wi or Wr ■ If it becomes the parent of 
cells in both, let it be regarded as two incursions. 

Definition 2.18 Let the cell c, the parent of the newly black cells in the incursion, be called 
the parent of the incursion. 

Definition 2.19 Let a white incursion, and its parent, be defined in a similar manner; that 
is, a situation in which a white cell becomes the parent of cells formerly in B. 

Definition 2.20 Let a black incursion possibility be a situation in which an incursion into 
Wi is possible, because ci has died, or a situation in which an incursion into Wr is possible, 
because C4 has died. Similarly, let a white incursion possibility be a situation in which an 
incursion into B with parent in Wi is possible, because C2 has died, or an incursion into B with 
parent in Wr is possible, because C3 has died. 
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We now show that as the size of the bordering white domain becomes arbitrarily large, the 
expected size of a black incursion into that domain (if possible, as explained above), should 
approach |. 

Lemma 2.21 Let En be the expected size of a black incursion into a white domain W , given 
that there is a black incursion possibility with parent in B, and that \W\ = n. Then, under G 

lim En = l (2.5) 

Proof. Suppose the nearest cell w, in W, to B to stay alive is such that there are k dead 
cells in W between w and B. Then cells in W between w and B have parents of both colors, 
and their probability of becoming black is thus |. Now, the probability of there being k such 

k-1 _ 3/2\fc-l 



cells to die, under G, given the incursion possibility, is G(CCC )(1 — G(CCC)) 



That is, each white cell with two white neighbors has probability G(CCC) = | of living. Thus 



5V5- 



k=l k=l 



We also bound the expected size of a white incursion. 

Lemma 2.22 Let E.^ be the expected size, under G of a white incursion into B from a white 
domain W , given that there is a white incursion possibility with parent in W , and that \B\ = m. 
ThenEn, < |. 

Proof. Suppose the nearest cell 5, in i? to to stay alive is located so that there are k 
dead cells in B between b and B. Then cells in B between b and W have parents of both colors, 
and their probability of becoming white is thus |. Now, the probability of there being k such 

k-1 _ 2/3\fc-l 



cells to die, under G, given the incursion possibility, is G(DDD)(1 — G(DDD)) 
(Since each black cell with two black neighbors has probability | of living.) Thus 



5V5- 



= E(|)(|)(!^^ < = ! (2-7) 



k=l k=l 



The main theorem follows: 
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Theorem 2.23 Let B be a small black domain on a doubly infinite lattice, on which the Pris- 
oner's Dilemma game G is run. Let all variables be as described above. Then, if \B\ > 2, and 
Wi and Wr are large enough, the expected value of SB, which is roughly the expected change in 
the number of black cells in the vicinity of W , is positive. 

Proof. We examine eight cases, depending on the life of ci, C2, C3, and C4. Note that ci 
and C4 have probability G(CCD) = G(DCC) = ^ of living; and C2 and C4, have probability 
G{CDD) = G{DDC) = ^. 

1. All four cells live. Then SB = 0. 

2. ci, C2, C3 live, C4 does not (or the reflection of this case). The probability of this is 

There is one black incursion possibility (with C3 as the parent), of expected 
size that approaches |, as the neighboring domain becomes arbitrarily large. 

3. ci, C2 live, C3 dies, C4 lives (or the reflection). The probability of this is 2(:^)(:^)(:^)^. 
There is one white incursion possibility (with C4 as the parent), of expected size < |. 

4. ci, C2 live, C3, C4 die (or the reflection). The probability of this is 2[^)[jq)[yq)[jq). There 
is one black incursion possibility (with C2 or a cell between C2 and C3 as the parent), of 
expected asymptotic size |; and there may be one white incursion possibility (with a cell 
to the right of C4 as the parent), of expected size < |. 

5. ci dies, C2 lives, C3 lives, C4 dies. This case has probability . There are two black 
incursion possibilities (with C2 and C3 as the parents), of expected asymptotic size | each. 

6. ci dies, C2 lives, C3 dies, C4 lives (or the reflection). The probability of this is 2(:^)^(:^)^. 
There is one black incursion possibility (with parent C2), of expected asymptotic size |; 
and one white incursion possibility (with parent C4), of expected size < |. 

7. ci dies, C2 lives, C3 and C4 die (or the reflection). The probability of this is 2(:^)^(:^)(:^). 
There is one black incursion possibility (with parent C2), of asymptotic size |; and there 
may be one white incursion possibility (with parent to the right of C4), of expected size 

^ 4- 
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8. C2 and C3 both die. The probability of this is . There may not be a black incursion, if 
every cell in D dies. There are at most two white incursion possibilities of expected size 
< I each. 

Thus, if \B\ > 2, and Wi and Wr are large enough, under all cases the expected value of SB 



However, it is not always the case that, in a two-strategy system, the "dominant" strategy 
will prevail. One strategy may lose against another, but do so well against itself that its use tends 
to expand. This happens in zero-depth versions of the previously discussed Stag Hunt, a game 
similar to the Prisoner's Dilemma, except that successful cooperation is more profitable than 
exploitation. If computer experiments (Figure D.17) simulate this game, giving a high enough 
premium for mutual cooperation, then cooperative behavior does tend to prevail. Specifically, 
the game has the same radius and number of moves as the Prisoner's Dilemma game described 



above. Its table is: G(CDC) = i§, G(CDD) = G(DDC) = ^, G(CCC) = 1, G(DDD) = ^, 
G{CCD) = G{DCC) = ^, G{DCD) = 0. 



It is possible, using the same techniques as above, to show that black domains are unstable 
in this game. 

Theorem 2.24 Let W he a small white domain on a doubly infinite lattice, on which the Stag 
Hunt game as described above is run. Let Bi and Bj. be its neighbors, and \W\ its size in 
generation 1. Let SW equal the number of cells that were black in generation 0, and which 
in generation 1, have white strategies descended from the strategies of cells in W - minus the 
number of cells that were in W in generation 1, and are black in generation 2. Then, if\W\ > 2, 
and Bi and Bj. are large enough, the expected value of SW , roughly the expected change in the 
number of white cells in the vicinity of W , is positive. 

Proof. The same calculations as described above are carried out, except that white and 
black are exchanged, and the probabilities of the Stag Hunt game are used. The asymptotic 
expected size of a white incursion, given the possibility of such, turns out to be 2. The expected 
size of a black incursion, given the possibility of such, turns out to be less than or equal to ^ 
(since cells that are white and bordered on both sides by white neighbors cannot die). The 



must exceed 2(^)(^)3(|) - 2(^)(^)3(|) + 2(^)2(^)2(| _ | 



) + (^r2(|) + 2(^)2(^)2(1 
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asymptotic expected change in the number of white cells in the vicinity of W turns out to 
exceed |||. I 

256 

Nash equilibria of cellular games have also been analyzed [3]. 

Definition 2.25 In a cellular game context, a symmetric Nash equilibrium (SNE) arises 
if, when the r nearest neighbors of a cell on each side use strategy s, its best response is also to 
use s. 

For example, in the Stag Hunt game described above, both unilateral cooperation and 
defection give rise to such equilibria. That is, if the neighbors of a cell always cooperate 
(defect), a cell is best off cooperating (defecting) too. 

As with ring viability, it is easy to assume that Nash equilibria determine the course of 
a game; that is, that a strategy giving rise to a symmetric Nash equilibrium is stable under 
invasion by other strategies. However, while the study of Nash equilibria is a promising avenue 
to understanding cellular games, such an automatic assumption is not necessarily the case. For 
example, in the Stag Hunt, unilateral cooperation gives rise to a SNE. However, in some versions 
of this game, cooperating domains are unstable. This is because though isolated defecting cells 
don't survive well, they are likely to kill off their neighbors. Thus, they tend to have more 
descendants than their neighbors. 

The parameters used in this version of the Stag Hunt are not exactly the same as above. 
They are: G{CDC) = if, G{CDD) = G{DDC) = if, G{CCC) = 1, G{DDD) = i|, G{CCD) 
= G{DCC) = ^, G{DCD) = 0. 

Computer experiments simulating this process (Figure D.18) do indeed suggest that white 
domains are unstable. This result can also be proved using the same techniques as above. 

Theorem 2.26 Let B be a small black domain on a doubly infinite lattice, on which the second 
Stag Hunt game as described above is run. Let Wi and Wr be its neighbors, and \B\ its size 
in generation 1. Let SB equal the number of cells that were white in generation 1, and, in 
generation 2, have black strategies descended from the strategies of cells in B - minus the 
number of cells that were in B in generation 1, and are white in generation 2. Then, if \B\ > 2, 
and Wi and Wr are large enough, the expected value of SB, roughly the expected change in the 
number of black cells in the vicinity of B, is positive. 



30 



Proof. The same calculations as described for the Prisoner's Dilemma case are carried out, 
except that the probabilities of the second Stag Hunt game are used. The asymptotic expected 
size of a black incursion, given the possibility of such, turns out to be |, since cells that are 
white and bordered on both sides by white neighbors cannot die. The expected size of a white 
incursion, given the possibility of such, turns out to be less than or equal to . The asymptotic 
expected change in the number of black cells in the vicinity of B turns out to exceed B 

Thus, we see that cellular game behavior is difficult to anticipate. These systems reflect the 
richness of living ecologies, in which a species' survival is determined by how well the organisms 
of that species compete with others, how well they cooperate among themselves, and how many 
descendants they have. No one factor automatically decides the issue. 
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Chapter 3 



Two Symmetric Strategies 

3.1 Introduction and Definitions 

Under the zero-depth model described previously, the simplest case to examine is that of games 
with only two possible strategies. Let these strategies be called black and white; and let a cell 
using a black (white) strategy be called a black (white) cell. We thus have the following model. 
Associated with each cell, in each generation, are: 

• A binary- valued move/strategy variable. 

• A binary- valued life variable. This variable can be set to either living, or not living. 
In each generation, cell strategies change, as follows: 

• The probability that the life variable of a cell is set to 1, so that it "lives" into the next 
generation, is determined by a universal and unchanging game matrix G. That probability 
is based on the move/strategies of a cell, and those of its r nearest neighbors on each side, 
in that generation. 

• A live cell keeps its strategy in the next generation. 

• A cell that does not live is given a new strategy for the next generation. This strategy is 
either that of its living nearest neighbor to the left, or to the right, with a 50% probability 
of each. If there are no living neighbors to either side, all possible strategies are equally 
likely. 
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We wish to understand the long-term behavior of such processes. For simplicity, we first 
consider systems with infinitely many cells. And, to understand their behavior in general, it is 
illuminating to first consider their behavior in the following case, in which the possible future 
courses of evolution are countable. 

Definition 3.1 Initial conditions in which there are finitely many black cells are ca/Zec? finitely 
describable initial conditions. 

Note that if there are initially only finitely many black cells, there will always be only finitely 
many black cells. Therefore, it is more appropriate to speak about a game evolving under such 
conditions, than from such conditions. 

The following definitions are also used: 

A domain (Definition 2.16 is a contiguous row of same-colored cells. 

Definition 3.2 Under finitely describable initial conditions, let the zone of uncertainty start 
with the leftmost black cell and end with the rightmost one. If there are no black cells, there is 
no such zone. 

Now, suppose each cell had probability 1 of staying alive, no matter what. Then all dynamics 
would be trivial; the system could never change. We would like to avoid such situations; that is, 
we would like to assure that change is always possible. We would also like to assure that, under 
initial conditions as described above, the two domains on either side of the zone of uncertainty 
will, almost always, contain infinitely many living cells. Both ends are achieved by specifying 
that each cell always has positive probability of either living or not living. 

Definition 3.3 Let a cellular game as described above; that is, zero depth, with two strategies, 
and the above restrictions on life probabilities, be called a simple cellular game. 

Now, the main problem associated with any stochastic process is to figure out how it behaves 
in the long run; not only to figure out how it may behave, but how it must behave. 

In this chapter, we settle this question, at least partially, for certain classes of games. 
That is, we consider simple cellular games with left /right symmetry, evolving under finitely 
describable initial conditions. We show that for such games, the probability that the zone of 
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uncertainty will grow arbitrarily far in one direction only is zero. It must, with probability 1, 
either disappear, or grow forever in both directions. 

How is this proved? First, we use Theorem 3.4, presented below, a result which applies both 
to cellular games and other stochastic processes. This theorem implies that if a simple cellular 
game evolves as above, and if, under any conditions, the probability this zone will "glide" 
arbitrarily far to the left is positive, there are initial conditions under which this probability 
can be made as high as desired; that is, greater than 1 — e, for any e > 0. 

Then, we show that under such initial conditions 7^, with very high probability of the zone of 
uncertainty "gliding" off in one direction, there would have to be probability greater than some 
constant that another glider will spin off and shoot out in the other direction. This constant 
would not depend on the initial conditions, but only on the game. This part of the proof is 
accomplished in the following manner: 

First, without loss of generality, we locate so that the rightmost black cell is cell 0. 

Then, we count cases in which the zone of uncertainty "glides" arbitrarily far in one direction 
only. We need to count cases in such a way that no case is counted twice. To do this elegantly, 
we restrict our attention to particular cases in which this zone moves to the right in a certain 
way; that is, those cases in which, just before this zone moves past cell for the last time, there 
is exactly one nonnegative black cell, at position r or greater. 

In a lemma, it is shown that under any 7^, with e small enough, the probability that the 
"glider" will operate in such a way is more than some fixed proportion 7 of the probability 
that a glider will operate at all. This 7 is dependent on the game only, and not on the initial 
conditions. Thus, the sum of all such cases must be greater than 7(1 — e). 

For each such case, we show there is another case with probability only a fixed proportion 
less, in which another glider goes off in the other direction. To do this, we use the fact that 
what happens at the end of the zone of uncertainty; that is, to some specific, fixed number of 
cells, cannot change the probability of a one-generation history very much. 

Thus, we can put a lower bound [i to the probability that in generation g, the game behaves 
exactly as in the case counted above, except that a two, three or four-cell black domain D is 
spun off, at a distance from all other black cells greater than the radius of the game. 
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We can show that if there is any positive probability of a glider moving in one direction, 
there is positive probability at least a that, if the zone of uncertainty contains only a domain 
like D: 

1. This zone will act like a glider, moving arbitrarily far to the right. 

2. This zone will, in every generation, contain more than one black cell. 

Note that this a will also apply if the positive cells are as above, and the negative black 
cells D itself acts as a glider, moving to the right and staying from that point on in the positive 
area, and that this glider from that point on continues to contain two or more cells. Since 
the negative black cells are themselves acting as a glider, it can be shown that they will not 
interfere with the behavior of cells in the positive area. It is in this part of the proof that the 
left/right symmetry comes in; it is used to show that gliders can move in both directions. 

Since this right-traveling glider continues to contain two or more cells, we are able again to 
avoid counting cases twice. That is, each case is assigned to the last generation in which there 
is exactly one nonnegative black cell. 

Thus, the probability that the domain between the two gliders will grow arbitrarily large, 
and the zone of uncertainty will continue to expand forever in both directions, can be given a 
lower bound. It can be shown, for small enough e, to be greater than 7/3q!(1 — e), with these 
constants depending only on G. If e is small enough, this forces a contradiction. In reference 
to these two gliders, this main theorem. Theorem 3.14, is called the Double Glider Theorem. 

Another kind of initial condition is also discussed; that is, initial conditions under which 
there is a leftmost white cell and a rightmost black cell. A conjecture is presented which applies 
to such conditions. 

Processes that are symmetric black/white, as well as right /left, are discussed. They are 
separated into two categories, mixing processes and clumping processes. This separation is 
based on their behavior under standard restricted initial conditions. The properties of clumping 
processes are further examined. In this context, a theorem is used which can be applied to 
symmetric random walks in general. 

Finally, computer experiments are presented. These models simulate the evolution of simple 
cellular games, with both kinds of symmetry, on a circular lattice. It is shown how this evolution 
varies as parameters vary. 
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The following theorem applies to all discrete-time Markov chains. It can be used to charac- 
terize cellular game evolution under finitely describable initial conditions. 

Theorem 3.4 Let M = {X(t),t G 0,1,2,...} be a discrete-time Markov chain. Let a finite 
history be a list of possible values for X(i), < i < n, for some < n < oo. Let H be any 
collection of infinite histories, which can be expressed as a countable Boolean combination of 
finite histories. Furthermore, let no finite part of any history in H determine membership in 
H . Let the probability of LI , under any initial conditions X(0) = x, be positive. Then, for any 
e > 0, there are initial conditions L^ such that there is probability 1 — e the infinite history of 
this process (that is, the values o/X(0),X(l), . . .,X(ra), . . .) will be in H . 

Proof. Let all possible finite histories of M, given X(0) = x, be placed in correspondence 
with open intervals in (0, 1) as follows: 

1. L fPxi > 0, let the event that X(l) = i correspond to the open interval iJ2j<:i Pxj^ '^j<i 

Pxi ) • 

2. Suppose X{n) = s in generation n, n > 1. Let the interval (a, b) correspond to the values 
of X(0) . . .X(n). Then, if P^i > 0, let the event that X(n -|- 1) = i in this generation 
correspond to the open interval (a + J2j<i Psjib — a),a + J2j<i Psj + Psii^ — d))- 

Similarly, let countable Boolean combinations of finite histories correspond to countable 
Boolean combinations of history intervals. Note that under this relationship, the probability of 
any finite history equals the length of the interval; and the probability of any countable boolean 
combination of finite histories H equals the Lesbegue measure of the corresponding measurable 
subset of (0, 1). Thus, if H has positive probability, it corresponds to a real subset S of (0,1) 
of positive measure. 

By a theorem of real analysis [21], if 5 fl (0, 1) has positive measure, there is some point p 
contained in (0, 1) such that 

lim l^iSn{p-e,p + e)) ^ ^ 

e^o 2e ^ ^ 

By the construction, there is a history interval contained in every interval on the unit line. 
Hence, for every e > 0, there is a history interval /, corresponding to a finite ra-step history h 



36 



in which X(n) = s, such that ^^^^^^^ > 1 — e- By the construction, then, the probability that 
the future history of M will be in H , given h, exceeds 1 — e. By the Markov property of M, 
and the fact that the finite history h does not determine membership in H , the probability of 
this, given X(0) = s, must also exceed 1 — e. B 

Note that for this theorem to apply, H must be such that no finite history determines 
membership in H . For example, H cannot be all histories such that X(2) = 1. On the other 
hand, H could be all histories such that X(n) = 1 for infinitely many n. 

Corollary 3.5 Let G be any simple cellular game. Let it evolve under finitely describable 
initial conditions. Let H be any countable Boolean combination of finite game histories. Let 
the probability of H , under any initial conditions, be positive. Then, for any e > 0, there are 
finite initial conditions such that there is probability 1 — e the infinite history of this game will 
be in H . 

Proof. Let the state X(g) of G in generation ^ be a list of black cells at the beginning of that 
generation. Thus, the states of G can be matched with the positive integers. The evolution of 
G can be considered a Markov chain, since the probability of entering any state is dependent 
on conditions in the previous generation only. I 

3.2 The Double Glider Theorem 

The Double Glider Theorem applies to all simple cellular games with left /right symmetry. It 
shows that if such a game evolves under finitely describable initial conditions, the probability 
that the zone of uncertainty will expand arbitrarily far in one direction only is zero. That is, 
the zone of uncertainty cannot "glide" forever to the left, or right. It is shown that if such a 
glider could evolve, as it progressed it could throw off a refiected glider, moving in the opposite 
direction; and that if both such actions had positive probability, there would be a contradiction. 
A new definition is used in the implementation of this proof. 

Definition 3.6 Let the effective zone of uncertainty consist, in each generation, of cells 
in the following categories: 

L Cells in the zone of uncertainty. 
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2. Cells beyond the zone of uncertainty that have a black cell as one of their nearest living 
neighbors. 

That is, cells beyond the zone of uncertainty that can become either black or white are also 
in this zone. The extent of this zone in generation g is dependent not only on cell colors at the 
beginning of that generation, but on life/death decisions made during that generation. 

Thus, the evolution of a simple cellular game, under finite initial conditions, can be con- 
sidered to occur in each generation as follows: First, life/death decisions are made about cells 
within the zone of uncertainty. Then, if the leftmost living cell in the zone of uncertainty is 
black, life/death decisions are made about cells to the left of this zone. These decisions start 
with the cell on its border, and proceed left until one lives. Then, if the rightmost living cell in 
the zone of uncertainty is black, decisions are made in the same way about cells to the right of 
this zone. Finally, black/white decisions are made. There are no other decisions that can affect 
the course of this game. 

The concept of effective zone of uncertainty can be extended to apply to cells on each side 
of a domain. 

Definition 3.7 Let the left effective zone of uncertainty Di of a white domain D consist 

of: 

1. Those cells in the effective zone of uncertainty to the left of D. 

2. Those dead cells in D whose nearest living neighbor to the left is black (and thus to the 
left of D). 

Let the right effective zone of uncertainty D,. be defined similarly. 

Thus, cells that are in _D, and not in either Di or D,., must stay white. We now show that 
if these two effective zones stay separated far enough, they cannot affect each other. 

Theorem 3.8 Let G be a simple cellular game of radius r, operating under finite initial condi- 
tions. Let D be a white domain under G. In generation g, let D include at least cells through 
r. Furthermore, let all cells in Di be to the left of cell and all cells in Dj. be to the right of 
cell r. Then the life/death probability of any cell in Di (D,/) will not have been influenced by 
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that of any cell in Dj. (Di). Also, black/white decisions for all cells in Di (D,/) will he exactly 
the same as if (Di) did not exist; that is, if Di (D,/) comprised the entire effective zone of 
uncertainty. 

Proof. The first statement is true because \D\ > r + 1. The second statement is true because 
if the effective zone is as thus stated, each cell in Di (Dj.) must have at least one parent in Di 
(Dj.), and no dead cell can have parents from both Di and Dj. unless both parents are white. I 

The following lemmas characterize the expansion of the zone of uncertainty. 

Lemma 3.9 Let G be a simple cellular game with left/right symmetry. Let R{g) he the position 
of the right border of the zone of uncertainty in generation g, if it exists. Let ai he the smallest 
probability that any cell stays alive, and a2 the largest. Then, for any n, there is always 
probability at least ^(ai)^(l — a2)^'^^ that R(g+2) — R(g) > n; and probability at least ^^'^^ af(l — 
Q!2)"+2 that R(g) - R(g + 2)> n. 

Proof. Without loss of generality, assume R(g) = 0; that is, assume that cell is black 
and there are no black cells to the right of it. Thus, there is probability at least Q!i(l — a2)^'^^ 
that, in generation g, cell lives, and all cells between it and cell ra + 2 do not. Given these 
events, there is probability at least ^ that cell ra + 1 becomes black in that generation. Given 
these events, in generation g + 1 there is probability at least cii that cell ra + 1 lives, thus 
staying black into the next generation. Thus there is probability at least ^(ai)^(l — a2)^~^^ 
that R(g + 2) - R(g) > ra. 

Now, suppose cell — ra — 2 is black. Then there is probability at least (ai)^(l — (12)"'^'^ that, 
in generation g, cell 1, which is white, lives, cell — ra — 2 lives, and all cells between those two do 
not. Given these events, there is probability ^""'"^ that cells through — ra become white, and 
cell — ra — 1 black, in that generation. Given these events, in generation g^ \ there is probability 
at least (cii)^ that cells — ra and — ra — 1 both live. This will ensure that at the beginning of 
generation + 2, the zone of uncertainty will still exist and have the desired border. 

On the other hand, suppose cell — ra — 2 is white. Then there is probability at least — 
01.2)"'^^ that, in generation ^, cell 0, which is black, lives, cell n — 1 lives, and all cells between 
these two do not. Given these events, there is probability that cell — ra — 1 becomes black, 

and cells — ra through —1 become white in that generation. Given these events, in generation 
^ + 1 there is probability at least — Q!2) that cells — ra — 1 and — ra live and cell dies. As 
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before, this will ensure that at the beginning of generation + 2, the zone of uncertainty will 
still exist and have the desired border. Thus, there is probability at least ^^'^^af(l — a^)"'^'^ 
that R{g) - R(g + 2) > ra. ■ 

Similar results, of course, apply to L(g). 

Lemma 3.10 Suppose the zone of uncertainty moves arbitrarily far to the left only. Then the 
probability that its right border will not recede arbitrarily far to the left (that is, that it will stay 
within some bounded interval) is 0. Furthermore, the probability that the right effective border 
will not also recede arbitrarily far to the left is . 

Proof. Let cii be the smallest probability that any cell stays alive, and a2 the largest. Let 
R(g) be as above. By Lemma 3.9, if —k < R(g) < k there is probability at least |(q!i)^(1 — 
^^^fc+ra+i ii^^g^i ji(^g -\- 2) > n. Thus, if —k < R{g) < k for infinitely many g, then R{g) will 
almost always, infinitely many times, be greater than any n. 

Let R'ig) be the position of the right border of the effective zone of uncertainty in generation 
G. (Again, let R'{g) be defined only if this zone exists.) Each time R'{g) > —k, either 
R(g) > —k, or cell —k has 50% probability of becoming black. If this cell does become black, 
R(g + 1) will exceed —k. Thus if R'(g) exceeds —k infinitely many times, R(g) will, with 
probability 1, exceed —k infinitely many times too. I 

As above, similar results, apply to the left border of the zone of uncertainty. 

Some concepts are now presented for subsequent use. 

Let a cell history for generations g up to h consist of: 

1. The system state (that is, the positions of all black cells) at the beginning of generation 

g- 

2. All meaningful life decisions made in generations g through h—1; that is, all life decisions 
made within the zone of uncertainty, and for those cells outside it whose nearest living 
neighbor on one side is black. 

3. All color decisions made where color is in doubt; that is, for cells that die and have nearest 
living neighbors of different colors on each side. 
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Let H(g,h) refer to a cell history as described above. Note that this description only refers 
to life decisions made within the effective zone of uncertainty. Thus, the probability of any 
history is affected only by such decisions. 

Let the following function be defined for any cell history h = H(l,g) that starts at generation 
1. Let Fi(h) = 1 if, under h, in generation g there is exactly one nonnegative black cell, at 
position r or greater. Let Fi(h) = otherwise. 

Similarly, let F2 and F3 be defined for one-generation cell histories h = h(g,g-\- 1). Let 
F2(h) = 1, if in generation g there exactly one nonnegative black cell, in position r or greater 
(that is, if Fi would be 1 for the previous history), and, under h, in generation g + 1 there are 
none; and let F2(h) = otherwise. Let Fslh) = 1 if in generation g + 1 there are two, three or 
four black nonnegative cells, both next to each other, and both in positions r or greater. Let 
Fslh) = otherwise. 

The following lemmas are used in constructing the main proof. The next two lemmas, 
which compare the probabilities of different 1-generation cell histories, both use the same idea: 
Changing what happens to only a specific number of cells is likely to have only a limited effect 
on the probability of the history. 

Lemma 3.11 Let G be a simple cellular game. Fhen for each 1-generation history h such that 
F2(h) = 1, there is a different 1-generation history h' such that all the following apply. 



2. h and h' both start with the same system states. 

3. At the end of generation g, given history h' , the negative black cells are exactly the same 
as those at the end of g given h. 

4. For any history (starting at generation 1) Hq, we have 



1. Fs(h') = 1. 



P(H(g,g+l) = h'\H(l,g)=ho)> 



(3.2) 



/3P(H(g,g+l) = h\H(l,g) = ho) 



(3.3) 



with (3 depending only on g. 
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Proof. Let h he a cell history such that F2(h) = 1. That is, at the beginning of the 
generation g in which h occurs, there is one nonnegative black cell c. Under h, c must die, 
because in generation g + 1 there will no longer be any more nonnegative black cells. Let b be 
the nearest cell to c, on the left, that stays alive in generation g. 

Let cii be the smallest probability that any cell stays alive, and a2 the largest. By the 
definition of a simple cellular game, both these numbers must be greater than 0. Let be the 
minimum of cii, Q!2, 1 — cii, 1 — Q!2. 

Case L b is black (and thus in a negative-numbered position). Let cell d be the closest living 
neighbor of cell c on the right. Let it die as before, and let cell d + 1 die. As under h, all dead 
cells between b and d have a 50% chance of becoming black. Let their colors be assigned the 
same; e.g., cells through d — 1 will become white. Let cells d and d-\- 1 become black. Let all 
other life/death and black/white decisions be as under h. 

Thus, this new history h' satisfies Fslh') = 1, it produces the same negative black cells as 
h, and we have 



Also, h can be reconstructed if h' is known; that is: 

1. Initial conditions are the same for both histories. 

2. Under h' , the location of cells d and d+l are known; they are the only nonnegative black 
cells in generation g + 1. 

3. All life/death and color decisions in the effective zone of uncertainty are the same, except 
for cells d and d + 1. 

4. The history of cell d, under h, is exactly known. It stays alive and stays white. 

5. The life or death of cell d + 1, under h, is not known. However, under h, this cell is not 
in the effective zone of uncertainty and decisions about it are not considered part of the 



P(H(g,g+l) = h'\H(l,g)=ho)> 
'-^P{H{g,g+l) = h\H{l,g) = ho) 



(3.4) 



(3.5) 



cell history. 
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Thus, in this case, for each different h there is a different h' satisfying the conditions of this 
lemma. 

Case II: Cell b is white, and one cell to the left of c. Under h' , let cells c and c + 3 live. 
Let cells c + I and c + 2 die. Since c is their right parent, they can become black in the next 
generation; let them do so. 

Let all other cells live or die, and change color, as under h. Note that cell c cannot become 
a parent of cells to the left, since it is bordered on the left by the living cell b. 

Thus, F'iih') will be I, it will produce the same negative black cells as h, and we have 



P{H{g,g+l) = h'\H{l,g)=K)> (3.6) 
^-^P{H{g,g+l) = h\Hil,g) = ho) (3.7) 

A history h' constructed in this manner cannot be confused with one created using the first 
method, since at the end there are three nonnegative cells rather than two. Its uniqueness can 
be shown by methods similar to those used in the first case. 

Case III: Cell b is white and more than one cell to the left of c. Let cells c — 1 and c live; 
let cells c + 1 through c + 3 die, and let cell c + 4 live. Let all other cells live or die as under h. 

Now, cell c — 1 must be white, since cell c is isolated. Therefore, cells 5+1 through c — 2 
must, as under h, become white. Let cells c + 1 through c + 3 become black. Note that all other 
cells have the same color options as under h. 

Thus, F'iih') will be 1, it will produce the same negative black cells as h, and we have 



P{H{g,g+l) = h'\H{l,g)=ho)> (3.8) 
i^P{H{g,g+l) = h\H(l,g) = ho) (3.9) 

This h' cannot be confused with one created using the first two methods, since at the end 
there are four nonnegative cells rather than three or two. Its further uniqueness can also be 
shown by methods similar to those used in the first case. Therefore, the conditions of the 
theorem are satisfied for all three cases, with /3 = ^"g^ . I 

Now, if there is positive probability of a glider - that is, of the effective zone of uncertainty 
moving arbitrarily far in one direction only - then there is positive probability that in some 
generation g, this zone will leave the nonnegative area for the last time. 
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The following lemma characterizes, for certain initial conditions, how this can happen. For 
these conditions, we put a minimum bound on the probability that, in the generation this zone 
leaves the nonnegative area, there is exactly one black cell - and this cell is at position r or 
greater. This bound depends only on G. 

The ways this zone can leave the nonnegative area are divided into four cases. (Actually, 
three main cases; the last two are quite similar.) For each of these cases, a different construc- 
tion is used to accomplish the proof. As in the preceding lemma, each of these constructions 
uses histories that behave similarly to the ones under consideration, and hence have similar 
probabilities of occurrence. 

Lemma 3.12 Let G be a simple cellular game of radius r, operating under finite initial condi- 
tions I. Let ai be the lowest probability, under G, that any cell stays alive. Let there be positive 
probability that under L the effective zone of uncertainty moves arbitrarily far to the left; that 
is, that some generation g is the last in which the effective zone of uncertainty contains non- 
negative cells. Let Zg = 1 if this is true for generation g, and otherwise. Let P(3g, Zg = 1) 
exceed 1 — Let Xg = 1 if Zg = 1, and at the beginning of g there is only one nonnegative 
black cell, at position r or greater, and otherwise. Then, for some 7 depending only on G 



Proof. Let a2 be the highest probability, under G, that any cell stays alive. (By definition, 
cii, Q!2 > 0.) Let Q!3, again, be the minimum of cii, Q!2, 1 — cii and 1 — a2. Let a4 be the life 
probablity of a black cell whose r neighbors on each side are also black. Let Cg be the rightmost 
living cell in the zone of uncertainty, in generation g. Let Dg be the rightmost black domain in 
that zone, and let Cg be the white cell at its left border. 

First of all, we know that there is probability at least cii that in generation 1, the leftmost 
black cell lives. Therefore, there is probability at least cii that Zi = 0. Thus, if P(3g, Zg = 
1) > 1 - ^, we know that P{3g,g >2,Zg = l)> ^. 

Now, suppose there exists a generation g > 1 such that Zg = 1. The conditions under which 
that occurs can be divided into four cases, as follows: 

1. Cg, as described above, is black. 
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2. Cg is white, and Cp_i is black. 

3. Cg is white, Cp_i is white, and e^-i is alive. 

4. Cg is white, Cp_i is white, and Cg-i is not alive. 

Let Cg he k, 1 < k < 4, if case k holds. Thus, there is a A;, 1 < A; < 4, such that 

P(3g, Zg = l,Cg = k)> ^ yP(35, Zg = 1) (3.11) 

Case I. (3.11) is true with k set to 1. In this case, Cg is black. Let dg be the living cell just 
to the right of the effective zone of uncertainty. For Zg to be 1, dg must be at position 1 or 
greater. 

We wish to show that for each two consecutive 1-generation histories h, i such that if 
H(g,g -\- 1) = h, Cg = 1, there exists a different collection of histories h', i', such that, for k 
depending only on G, we have 



PiHig,g+l) = h',Hig+l,g + 2) G ^') > (3.12) 
KP(H(g,g+l) = h,H(g+l,g+2) = t) (3.13) 

(3.14) 



P{Xg+r = l\H{g,g+l) = h', (3.15) 
H(g+l,g + 2)et')= (3.16) 
P(Zg = l\H(g,g+l) = h, (3.17) 
H(g+l,g + 2) = t) (3.18) 

Let h' be constructed as follows: 

1. Initial colors are the same as under h. 

2. Cells dg through dg + r die. 

3. Cell d„ + r + 1 lives. 
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4. All other cells live or die as under h. Thus, cells dg through dg + r are the only ones with 
different color possibilities than under h; that is, they have a 50% chance of becoming 
black, with their parent. 

5. Cells dg through dg + r — 1 become white. 

6. Cell dg + r becomes black. 

7. All other cells become black or white as under h. 

At the end of h', we are left with exactly the same black cells as at the end of h, except 
that cell dg + r is black. And, because of cells added to the zone of uncertainty under h': 

P{H{g,g+l) = h') > ^-^L_P{H(g,g+l) = h) (3.19) 
Also, h can be reconstructed if h' is known; that is: 

1. Initial conditions are the same for both histories. 

2. The location of cell dg + r can be recovered. After the completion of h', it is the right 
black cell. Hence, the location of cell dg can be recovered. 

3. Under h, all life/death and color decisions in the effective zone of uncertainty, through 
cell dg — 1, are the same. 

4. Under h, cell dg lives, thus bounding the zone of uncertainty. 

For Zg to be 1, in generation g + 1 the effective zone of uncertainty must not reach the 
nonnegative area. Therefore, rf^+i must not be positive. Let H(g + 1,^ + 2) = i be such a 
history. Let i' be constructed as follows, given i and its predecessor h: 

1. Let initial colors be the same as under i, except that cell dg + r is black. (The position of 
dg can be determined, given h.) 

2. Let the life of all cells in the effective zone of uncertainty of i be determined as under i. 

3. Let cell dg + r — 1 live. Thus, since the effective zone of uncertainty of i stays in the 
negative area, all cells in this zone will face the same black/white decisions. Also, cells 
dg^i through dg + r — 2 must, if they die, become white. 



46 



4. Let cell dg + r die. 

5. Let cell dg + r + 1 live. Thus, cell dg + r will become white. 

6. Let all black/white decisions in the effective zone of uncertainty of i be determined just 
as under i. 

In this generation, cells rf^+i through dg + r — 2 can live or die without affecting the inclusion 
of a history in i'. Note that the only additional specification for what happens in i', as opposed 
to i, is the life or death of three particular cells. 

Thus, we have 

P(H(g + 1,5 + 2) G t'\H(g,g+l) = h') > (3.20) 
(asfP(H(g + 1,5 + 2) = t\H(g,g+ 1) = h) (3.21) 

Note that i can be recovered, given i' , because all decisions in the effective zone of uncertainty 
of i are the same. Also note that conditions after i' are the same as after i. Thus, we have 



P(Z,+i = l\H{g,g+ 1) = h',H{g+l,g+2) G ^') = (3.22) 
P(Zg = l\H(g,g+l) = h,H(g+l,g+2) = t) (3.23) 

Since i' starts with exactly one nonnegative cell, at position r or greater, (3.15) holds. 
Combining (3.19) and (3.20), we have (3.12) holding with k = ^^^^+1 • 
Since there is a different h' , i' for each different h, i, we have 



P(3g,Xg+i = l,Cg = l)> (3.24) 

^P(X,+i = l,C, = l| (3.25) 

g,h,i 

H(g,g+1) = h',H(g+l,g + 2) G ^') (3.26) 

P(H(g,g+l) = h',H(g+l,g + 2) G ^') > (3.27) 

J2P(Zg = hCg = l\ (3.28) 

g,h,i 

H{g,g+l) = h,H{g+l,g+2) = i) (3.29) 
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H.P{H{g,g+l) = h,H(g+l,g + 2) = ^) = (3.30) 
P(3g,Zg = l,Cg = l) (3.31) 

Thus, by our case hypothesis, we have 

P{3g, X,+i = 1, = 1) > ^ yP(35, Z, = 1) (3.32) 

Case II. (3.11) is true with k set to 2. In this case, Cg is white, and Cp_i is black. Let rf^-i 
be the living cell just to the right of the zone of uncertainty, in generation g — 1. Note that this 
cell is to the right of any cells that are black in generation g. Hence, for Zg to be 1, rf^-i must 
be at position 1 or greater. 

We wish to show that for each three consecutive 1-generation histories k, h, i such that if 
H(g,g -\- 1) = h, Cg = 2, there exists a different collection of histories k', h' , j' such that, for k 
depending only on G, we have 



P{H{g-l,g) = k',Hig,g+ 1) G h' , Hig + 1, g + 2) G ^') > (3.33) 

KP(H(g - l,g) = k,H(g,g+ 1) = h,H(g+l,g + 2) G ^) (3.34) 

and 

P(X,+i = l\H(g-l,g) = k',H(g,g+l) G h' , (3.35) 

H(g+l,g + 2)et')= (3.36) 

P(Zg = l\H(g-l,g) = k,H(g,g+l) = h, (3.37) 

H(g+l,g + 2) = t) (3.38) 

Let k' be constructed as follows: 

1. Initial colors are the same as under k. 

2. Cells dg-i through rf^-i + r die. 

3. Cell dg-i + r + 1 lives. 
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4. All other cells live or die as under k. Thus, cells rf^-i through rf^-i + r are the only 
ones with different color possibilities than under k; that is, they have a 50% chance of 
becoming black, with Cp_i as their parent. 

5. Cells dg-i through rf^-i + r — 1 become white. 

6. Cell dg-i + r becomes black. 

7. All other cells become black or white as under k. 

At the end of k' , we are left with exactly the same black cells as at the end of k, except that 
cell dg-i + r is black. And, because of cells added to the zone of uncertainty under k', we have 

P{H(g - 1,5) = k') > ^-^L_p{H(g -l,g) = k) (3.39) 
Also, k can be reconstructed if k' is known; that is: 

1. Initial conditions are the same for both histories. 

2. The location of cell rf^-i + r can be recovered. After the completion of A;', it is the right 
black cell. Hence, the location of cell rf^-i can be recovered. 

3. Under k, all life/death and color decisions in the effective zone of uncertainty, through 
cell dg-i — 1, are the same. 

4. Under k, cell rf^-i lives, thus bounding the zone of uncertainty. 

Let H(g,g+1) = hhe a history that, together with its predecessor k, satisfies the conditions 
for Cg to be 2, and for Zg to possibly be 1: That is, under h, let the leftmost living cell in the 
zone of uncertainty be white, and let this zone leave the nonnegative area. Let h' be constructed 
as follows, given h and its predecessor k: 

1. Let initial colors be the same as under h, except that cell rf^-i + r is black. (The position 
of dg can be determined, given h.) 

2. Let the life of all cells in the effective zone of uncertainty of h be determined as under h. 
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3. Let cell rf^-i + r — 1 live. Thus, since under h the the effective zone of uncertainty does 
not reach this far to the left, all cells in this zone will face the same black/ white decisions. 

Note that since under h the left border of the zone of uncertainty recedes, Cg - that is, 
the white cell at the border of this zone - must be to the right of cell rf^-i + r. Also, cells 
Cg through dg-i + r — 2 must, if they die, become white. 

4. Let cell dg + r live. 

5. Let cell dg + r + 1 live. 

6. Let all black/white decisions in the effective zone of uncertainty of h be determined just 
as under h. 

In this generation, cells Cg through dg + r — 2 can live or die without affecting the inclusion 
of a history in h' . Note that the only additional specification for what happens in h' , as opposed 
to h, is that three particular cells live. 

Thus, we have 



Note that h can be recovered, given h' , because all decisions in the effective zone of uncer- 
tainty of h are the same. 

For Zg to be 1, in generation g + 1 the effective zone of uncertainty must not reach the 
nonnegative area. Therefore, rf^+i must not be positive. Let H(g + 1, ^ + 2) = i be such a 
history. Let i' be constructed as follows, given i and its predecessors h and k: 

1. Let initial colors be the same as under i, except that cell rf^-i + r is black. (The position 
of dg-i can be determined, given k.) 

2. Let the life of all cells in the effective zone of uncertainty of i be determined as under i. 

3. Let cell rf^-i + r — 1 live. Thus, since the effective zone of uncertainty of i stays in the 
negative area, all cells in this zone will face the same black/white decisions. Also, cells 
dg^i through rf^-i + r — 2 must, if they die, become white. 



P(H(g,g+l)eh'\H(g-l,g) = k')> 
(asfP(H(g,g+l) = i\H{g - l,g) = k) 



(3.40) 



(3.41) 
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4. Let cell rf^-i + r die. 

5. Let cell rf^-i + r + 1 live. Thus, cell rf^-i + r will become white. 

6. Let all black/white decisions in the effective zone of uncertainty of i be determined just 
as under i. 

In this generation, cells rf^+i through rf^-i + r — 2 can live or die without affecting the 
inclusion of a history in i'. Note that the only additional specification for i', as opposed to i, is 
the life or death of three particular cells. 

Thus, we have 

P(H(g + l,g + 2)et'\ (3.42) 
H(g,g+l)eh',H(g-l,g) = k')> (3.43) 
(asfP(H(g+l,g+2) = t\ (3.44) 
H(g,g+l) = h,H(g-l,g) = k) (3.45) 

Note that i can be recovered, given i' , because all decisions in the effective zone of uncertainty 
of i are the same. Also note that conditions after i' are the same as after i. Thus, we have 



P(Zg+i = 1| (3.46) 

H(g -l,g) = k',H(g,g+l) G h' , H(g + 1, g + 2) G ^') = (3.47) 

PiZ, = 1| (3.48) 

H(g-l,g) = k,H(g,g+l) = h,H(g+l,g + 2) = t) (3.49) 

Since i' starts with exactly one nonnegative cell, at position r or greater, (3.35) holds. 
Combining (3.39), (3.40), and (3.42), we have (3.33) holding with k = 
Since there is a different k' , h', i' for each different k, h, i, we have 



P(35,X,+i = 1,C, = 2) > (3.50) 
^ P(X,+i = l,C, = 2| (3.51) 
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H{g - l,g) = k',Hig,g+l) G h' , Hig + 1, g + 2) G ^') (3.52) 

P(H(g - l,g) = k',H(g,g+ 1) G h' , H(g + 1, g + 2) G ^') > (3.53) 

E P(Z, = hC, = 2\ (3.54) 

g,k,h,i 

H{g-l,g) = k,H{g,g+l) = h,H{g+l,g+2) = i) (3.55) 

KP(H(g - l,g) = k,H(g,g+ 1) = h,H(g+l,g + 2) = t) = (3.56) 

P(3g,Zg = l,Cg = 2) (3.57) 

Thus, by our case hypothesis, we have 

P(3g, X,+i = 1, = 2) > ^ yP(35, = 1) (3.58) 



Case III. (3.11) is true with k set to 3. In this case, Cg is white, and Cp_i is white. Let bg-i 
be the white cell just to the right of -D^-i. In this case, bg-i equals Cp_i. 

We wish to show that for each three consecutive 1-generation histories k, h, i such that if 

H(g,g -\- 1) = h, Cg = 3, there exists a different collection of histories k', h' , j' such that, for k 
depending only on G, we have 

P(H(g - l,g) G k',H(g,g+l) G h' , H(g + 1, g + 2) G ^') > (3.59) 

KP(H(g-l,g) = k) (3.60) 

P(H(g,g+l) = h\H(g-l,g) = k) (3.61) 

P(H(g+l,g + 2) = t\ (3.62) 

H(g-l,g) = k,H(g,g+l) = h) (3.63) 

and 

P(X,+i = l\H(g-l,g) G A;', 1^(5, ^ + 1) G h' , (3.64) 

^^(5+l,5+2)G^')= (3.65) 

P(Z, = l\H(g-l,g) = k,H(g,g+l) = h, (3.66) 

H(g + l,g + 2) = t) (3.67) 

Let k' be constructed as follows: 



52 



1. Initial colors are the same as under k. 

2. Both the leftmost and rightmost cells in D live (cells bg-i + 1 and e^-i — 1). Thus, all 
cells in D must become black. 

3. Cells eg-i through e^-i + r die. 

4. Cell eg-i + r + 1 lives. Thus, cells e^-i through e^-i + r may become either black or 
white. 

5. All other cells, up to the left border of the zone of uncertainty of k, live or die as under 
k. In specific, bg-i lives, as under k. Thus, all cells to the left of bg-i are faced with the 
same black/ white decisions as under k. 

6. Cells eg-i through e^-i + r — 1 become white, and cell e^-i + r becomes black. 

7. All other cells become black or white as under k. 

Note that all cells in -D^-i, except for those on each border, can live or die without affecting 
the inclusion of a history in k' . 

At the end of any history in k', we are left with exactly the same black cells as under k, 
except that all cells in -D^-i are black and cell e^-i + r is black. 

Now, consider those cells in the interior of -D^-i. Under k, they must all die; under k' , their 
life or death does not matter. On the other hand, the two cells at the border of -D^-i die under 
k, and live under k' . Also, cells e^-i through e^-i +r are outside the zone of uncertainty under 
k. Under k' , they die, and their colors are specified. 

Thus, if n is the maximum of — 2r and 0, we have 

P(H(g - 1,5) G k') > -±^l—-^P(H(g -l,g) = k) (3.68) 
Also, k can be reconstructed if k' is known; that is: 

1. Initial conditions are the same for both histories. 

2. Under k, all life/death and color decisions in the effective zone of uncertainty, up to cell 
hg-i, are the same. 
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3. The location of cell bg-i can be recovered. After the completion of k' , it is the rightmost 
white cell in the next-to-rightmost finite white domain. 

4. Cell bg-i lives, as under k' . 

5. The location of cell e^-i can be recovered. After the completion of k' , it is the leftmost 
cell in the rightmost finite white domain. 

6. Under k, cells bg-i + 1 through e^-i — 1 die, and become white. 

7. Under k, cells e^-i and all cells to the right of it are outside the zone of uncertainty. 

Let H(g,g+1) = hhe a history that, together with its predecessor k, satisfies the conditions 
for Cg to be 3, and for Zg to possibly be 1. That is, under both k and h, let the leftmost living 
cell in the zone of uncertainty be white. Thus, since the right border of this zone will recede in 
generation g — 1, Dg is completely to the left of -D^-i. Also, in generation g, let this zone leave 
the nonnegative area; and let hg-i be alive. 

Let h' be constructed as follows, given h and its predecessor k: 

1. Let initial colors be the same as under h, except that cell e^-i -|- r, and all cells in -D^-i, 
are black. (The location of -D^-i, and hence of cells hg-i and e^-i, can be determined 
given k.) 

2. Let the life of all cells in the zone of uncertainty of h be determined as under h. (Note 
that Dg-i is to the right of this zone.) Furthermore, let cell Cg live or die as under h. 

3. Let the white cells at each border of -D^-i - that is, cells hg-i and e^-i - live. 

4. Let all cells in -D^-i die. Thus, they must all become white. 

5. Let cell Cg -\- r — 1 live. 

6. Let cell e^-i -|- r live. 

7. Let cell e^-i -|- r -|- 1 live. 

Note that in generation g, cells Cg through e^-i - that is, the cells between the border of 
the zone of uncertainty of h and the left border of -D^-i - can live or die without affecting the 
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inclusion of a history in h' . Also, cells e^-i + 1 through e^-i + r — 2, (if r is large enough for 
these cells to exist) can live or die without affecting this inclusion. 

At the end of any history in h' , we are left with exactly the same black cells as under h, 
except that cell e^-i + r is black. Now, since e^-i > > 0, we have e^-i + r) > r. And for Zg 
to be 1, there must be no nonnegative black cells at the end of generation g. Thus, at the end 
of h' there will be only one nonnegative black cell, cell e^-i + r. 

Now, consider those cells in the interior of -D^-i. Under h' , they must all die; under h, 
they are outside the zone of uncertainty. Also, those cells r or less to the left of -D^-i (cells 
bg-i — 1 through bg-i — r may have different life probabilities. Finally, we have to consider the 
life probabilities of cells e^, and + r — 1 through + r + 1. 

Thus, if n is the maximum of — 2r and 0, we have 

P{H{g,g+l) e h') > (a3r+'(l - a^rP{H{g,g + 1) = h) (3.69) 
Also, h can be reconstructed if h' is known. That is, 

1. Under h' , -D^-i is the second black domain on the left. 

2. Under h, initial conditions to the right of -D^-i are the same as under h' . 

3. Under h, the zone of uncertainty does not reach -D^-i. 

4. Decisions in the zone of uncertainty ofh, and at its border, both life/death and black/white, 
are exactly as under h. 

Now, for Zg to be 1, in generation g + 1 the effective zone of uncertainty must not reach 
the nonnegative area. Therefore, rf^+i must not be positive. Let H(g + 1,^ + 2) = i be such a 
history. Let i' be constructed as follows, given i and its predecessors h and k: 

1. Let initial colors be the same as under i, except that cell rf^-i + r is black. (The position 
of dg-i can be determined, given k.) 

2. Let the life of all cells in the effective zone of uncertainty of i be determined as under i. 

3. Let cell rf^-i + r — 1 live. Thus, since the effective zone of uncertainty of i stays in the 
negative area, all cells in this zone will face the same black/white decisions. Also, any 
cells between rf^+i and rf^-i + r — 2 must, if they die, become white. 
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4. Let cell rf^-i + r die. 

5. Let cell rf^-i + r + 1 live. Thus, cell rf^-i + r will become white. 

6. Let all black/white decisions in the effective zone of uncertainty of i be determined just 
as under i. 

In this generation, cells rf^+i through rf^-i + r — 2 can live or die without affecting the 
inclusion of a history in i'. Note that the only additional specification for i', as opposed to i, is 
the life or death of three particular cells. 

Thus, 

P(H(g+l,g + 2)et'\ (3.70) 
H(g,g+l)eh',H(g-l,g) = k')> (3.71) 
(asfP(H(g+l,g+2) = t\ (3.72) 
H(g,g+l) = h,H(g-l,g) = k) (3.73) 

Note that i can be recovered, given i' , because all decisions in the effective zone of uncertainty 
of i are the same. Also note that conditions after i' are the same as after i. Thus, we have 



P(X,+i = 1| (3.74) 

H(g-l,g) e k',H(g,g+ 1) G h' , H(g + 1, g + 2) G ^') = (3.75) 

PiZ, = 1| (3.76) 

H(g-l,g) = k,H(g,g+ 1) = h,H(g+l,g+2) = t) (3.77) 

Since i' starts with exactly one nonnegative cell, at position r or greater, (3.35) holds. 

Combining (3.68), (3.69), and (3.70), we have (3.59) holding with k = 2r+i — . 
Since there is a different k' , h', i' for each different k, h, i, we have 



P(35,X,+i = l,C, = 3)> (3.78) 
^ P(X,+i = l,C, = 3| (3.79) 
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H{g-l,g) e k',Hig,g+l) G h' , Hig + 1, g + 2) G ^') (3.80) 

P(H(g - l,g) G k',H(g,g+ 1) G h' , H(g + 1, g + 2) G ^') > (3.81) 

E P(^, = 1,C, = 3| (3.82) 

ir(5- 1,5) = k,H{g,g+l) = h,H{g+l,g+2) = i) (3.83) 

KP(H(g - l,g) = k,H(g,g+ 1) = h,H(g+l,g + 2) = t) = (3.84) 

Pi3g,Zg = l,Cg = 3) (3.85) 

Thus, by our case hypothesis, we have 

P{3g, X,+i = 1, = 3) > ^ yP(35, = 2) (3.86) 



Case IV. (3.11) is true with k set to 4. This case can be handled almost exactly the same 
as Case III. The only difference between the two is that, in Case IV, cell bg-i is not alive in 
generation g — 1. Under k' , this cell lives; and in this case, if k is reconstructed from k', it is 
assumed that this cell is not alive. Since, under k, the nearest living cell to the right of bg-i is 
white, all black/white decisions to the left of bg-i are the same for k' as for k. I 

Lemma 3.13 If there is positive probability that, given any finitely describable initial condi- 
tions, the zone of uncertainty will expand arbitrarily far to the left (right) only, there is positive 
probability a that, given a zone of uncertainty consisting of two, three or four, contiguous black 
cells: 

1. The effective zone of uncertainty will expand arbitrarily far to the left, never again going 
to the right of the position of the original black cells. 

2. The effective zone of uncertainty will never contain less than two black cells. 

Proof. Let cii be the smallest probability that any cell will live; and a2 the largest. 

By Lemma 3.10, if under any initial conditions there is positive probability the zone of 
uncertainty will expand arbitrarily far to the left only, there is positive probability that under 
these conditions the left border of the effective zone of uncertainty will expand arbitrarily far 
to the left, and the right border recede arbitrarily far to the left. 
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By Corollary 3.5, if there are initial conditions under which there is positive probability 
of the effective zone of uncertainty behaving as above, then, for any e > 0, there are initial 
conditions under which there is probability f — e of it behaving as above. 

Now, suppose that under there is probability 1 that the zone of uncertainty will eventually 
contain one cell. Then there is probability 1 — a2 that this zone will eventually disappear. If e 
is small enough, this is a contradiction. 

Therefore, at least for small enough e, under conditions 7^, there is positive probability that 
the zone will not only behave as above, but always contain at least two cells. Let 7 be one such 
probability, for any particular conditions 1^ . Let c be the cell on the right border of 7^. 

Now, under 7^, there must be some ra, such that that there is probablity at least ^ the zone 
of uncertainty will never reach cell c + ra. Let m be the length of the zone of uncertainty under 
If , plus n. 

The proof is completed by noting that if there are two black cells in the zone of uncertainty, 
there is probability at least Q!i(l — Q!2)™Q!i that the right black cell lives, its m neighbors on the 
right die, and the next white cell lives. Given this, there is probability |™ that the cells that 
die form the pattern of 7^, with n white cells to the right. Finally, given this pattern that is 
just like that of 7^, except for one black cell c, n units to the right, there is probablity at least 
^Q!i(l — Q!2)^ that c dies, its two neighbors live, and the rest of the zone does not ever reach 
cell c. 

Thus, there is probability at least a = ^(q!i)"^(1 — Q!2)™'''^^™ of events transpiring as desired. 

I 

The main theorem now follows. 

Theorem 3.14 (The Double Glider Theorem) Let G be a simple cellular game of radius 
r, with left/ right symmetry. Then, under G, with finite initial conditions, the probability that 
the zone of uncertainty will extend arbitrarily far in one direction only is zero. 

Proof. Suppose that under G, under any finite initial conditions, there is positive probability 
of the zone of uncertainty extending arbitrarily far to the left (or right) only. Without loss of 
generality, since G is symmetric, let us say the left. 

Then, by Lemma 3.10, there is positive probability that both left and right effective borders 
of the zone of uncertainty will move arbitarily far to the left. Since this refers to a countable 
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Boolean combination of finite histories, in which no finite history determines membership, 
Corollary 3.5 can be applied. That is, for any e > 0, there are fixed initial conditions such 
that, given these initial conditions, the probability of this happening is greater than 1 — e. 

Since this is true for any e > 0, let us assume that e < where cii is the smallest 
probability, under G, that any cell will stay alive. 

Also, without loss of generality, let the rightmost black cell, under 7^, be regarded as cell 
0. Thus, there is probability at least 1 — e that, in some generation g, the rightmost cell in the 
effective zone of uncertainty will be at a nonnegative position, and in all subsequent generations 
at a negative one. 

Thus, satisfies the conditions for Lemma 3.12. That is, there is a constant 7 such that 
if, under 7^, this crossover does occur, the probability it does so in a generation in which, at 
the beginning of the generation, there is only one nonnegative black cell (and that cell is at 
position r or greater) is at least 7. This 7 is not dependent on any other characteristics of 7^, 
but only on G. 

Let Xg be 1 if: 

1. At the beginning of generation g, there is only one nonnegative black cell. 

2. In generations g-\-l and later, the effective zone of uncertainty stays out of the nonnegative 
area. That is, it no longer contains nonnegative cells. 

Let Xg be otherwise. 

Thus, given initial conditions 7^, we can say that 

7(l-e)<^P(X, = l,Xfc = 0VA;<5)= (3.87) 

g 

J2P(H(h9) = h)P(Xg = l,Xfc = OVA; < g\H(l,g) = h) (3.88) 

Note that if X^, with A; < ^ is 1, Xg must be 0; that is, the effective zone of uncertainty 
can leave the nonnegative area for the last time in only one generation. Thus, the left side of 
(3.87) becomes 

^P(77(l,5) = h)P(Xg = l\H{l,g) = h) (3.89) 
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Separating out the effects of tfie next generation, we get 



^ P{H{l,g) = h)P{H{g,g+ 1) = h'\H{l,g) = h) (3.90) 

g,h,h' 

P{Xg = l\H{l,g) = h,H(g,g+l) = h') (3.91) 

Now, for it to be possible that Xg be 1, the cell history in generations 1 through g — 1 must 
meet certain conditions. That is, at the beginning of generation g there must be only one black 
nonnegative cell, at position r or greater; in other words, Fi(H(l,g)) must be 1. In addition, 
the history of generation g must meet certain requirements. That is, in generation g + 1 the 
zone of uncertainty must contain only negative cells; in other words, F2(H(g,g+ 1)) must be 
1. Thus, (3.90) becomes 



P(H{l,g) = h)Fr{H{l,g)) (3.92) 

g,h,h' 

P(H(g,g+l) = h'\H(l,g)=h) (3.93) 

F2{H{g,g+l))P{Xg = l\H{l,g) = h,H{g,g+ 1) = h') (3.94) 



Now, given initial conditions 7^, the probability that the zone of uncertainty does not extend 
arbitrarily far to the left only (that is, that it extends arbitrarily far to the right, or eventually 
disappears) has to be less than e. Since e is arbitrary, showing that this probability must be 
greater than some constant dependent only on G will force a contradiction. 

To show this, let r(g) be the position of the rightmost cell in the effective zone of uncertainty 
in generation g. Furthermore, let p be the probability that the zone extends arbitarily far to 
the right, or eventually disappears. Then p is larger than the probability that one domain in 
the middle of the zone of uncertainty grows arbitrarily large in both directions. This, in turn, 
is larger than the probability that, for some generation g all the conditions below hold: 

1. In generation g, there is only one nonnegative black cell c, at position r or greater. 

2. In generation g+1, there are two, three or four nonnegative black cells, both next to each 
other, and both at positions r or greater. 

3. The white domain D which in generation g is between cell c and all other black cells, 
grows arbitrarily large in both directions. 
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4. In generations g -\-2 and later, either the leftmost living cell of D is at position or less, 
or the leftmost cell in D is at position or less, and the leftmost living cell after that is 
white. That is, the left effective border of D is always at position or less. 

5. In generations g -\-2 and later, either the rightmost living cell of D is at position r — 1 or 
less, or the rightmost cell in D is at position r — 1 or less, and the rightmost living cell 
after that is white. That is, the right effective border of D is always at position r — 1 or 
less. 

6. In generation g -\- 2 and after, there are always more than two black cells to the right of 
_D; that is, at positions r or greater. 

That is, a white domain D develops in generation g, and the two "gliders" on each side of 
D in that generation fly apart, and never touch. The right glider, after generation g, always 
contains at least two black cells; and both gliders continue to exist forever. 

Now, we examine the probability of these events happening. Let 1^ be 1 if the above events 
are satisfied for generation g, and otherwise. 

Thus, the probability that the zone of uncertainty grows arbitrarily large in both directions 
is greater than 

Y,P{H{l.g) = h)P{Yg = l,Yk = OVA; < g\H{l,g) = h) (3.95) 

Now, Yg and Y^, with k < g, cannot both be 1. The reason for this is that for to be 
true, there must be exactly one black nonnegative cell in generation k, and never again. Thus, 
(3.95) is equivalent to 

Y,P(H{l,g) = h)P{Yg = l\H{l,g) = h) (3.96) 
or, separating out the effects of generation g, we have 

^ P{H{l,g) = h)P{H{g,g+ 1) = h'\H{l,g) = h) (3.97) 

g,h,h' 

P(Yg = l\H(l,g) = h,H(g,g+l) = h') (3.98) 
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For Yg to be 1, the cell history in generations 1 through g—1 must meet the same conditions 
that enable Xg to be 1; that is, in generation g there must be only one black nonnegative cell, at 
position r or greater. In addition, the history of generation g must meet certain requirements. 
That is, in generation g + 1 there must be two or more black nonnegative cells, both next to 
each other, and both in positions r or greater; that is, F3(H(g,g-\- 1)) must be 1. Thus, (3.90) 
becomes 

J2 P(H{l,g) = h)Fr{H{l,g)) (3.99) 

g,h,h' 

P(H(g,g+l) = h'\H(l,g) = h) (3.100) 
Fs{H{g,g+l))P{Yg = l\H{l,g) = h,H{g,g + 1) = h') (3.101) 

By Lemma 3.11, for every 1-generation history /i2 such that -F2(^2) = 1, there is a constant 
(3 depending only on G, and a 1-generation history such that 

1. Fsihs) = 1. 

2. Initial conditions are the same as under /i2. 

3. For any previous history (starting at generation 0) h, we have 

P(H(g,g+l) = hs\H(l,g)=h)> (3.102) 
f:SP(H(g,g+l) = h2\H(l,g) = h) (3.103) 

4. At the end of generation g, given history h^, the negative black cells are exactly the same 
as those at the end of g given /i2. 

Furthermore, for no two /i2 will this be the same. 
Thus, (3.99) is greater than 



P{H{l,g) = h)F^{H{l,g)) (3.104) 

g,h,h' 

/3P(H(g,g+l) = h'\H(l,g) = h) (3.105) 

F2{H{g,g+l))P{Yg = l\H{l,g) = h,H{g,g + 1) = h') (3.106) 
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For Yg to be true, the white domain D must, from that point on, include at least cells 
through r. Therefore, by Theorem 3.8, in all infinite histories for which Yg is 1, and all finite 
histories in which the possibility of Yg remaining 1 stays open, the actions of cells on the two 
sides of _D remain independent of each other. Hence, these actions can be considered separately, 
as if we were dealing with two different games. Thus, at the beginning of generation g + 2, 
the probability that behavior on both sides of D will be appropriate is the product of the 
probabilities of appropriate behavior on each side. 

The probability that the behavior on the left side is appropriate is the same as the probability 
that behavior on the left side would be appropriate if, at this point, the negative black cells 
were exactly the same as they are now, but there were no nonnegative black cells. 

Similarly, the probability that behavior on the right side is appropriate is just the probability 
that all behavior is appropriate, if the zone of uncertainty consisted only of two, three or four 
contiguous black cells. By Lemma 3.13, this probability is at least a. 

Note that this is where the left-right symmetry of G comes in; that is, the probability a 
symmetric zone of uncertainty will glide arbitrarily far to the left only must be the same as the 
probability it will glide arbitrarily far to the left only. 

Thus, (3.104) becomes 

J2 P(H{l,g) = h)Fr{H{l,g)) (3.107) 

g,h,h' 

f:SP(H(g,g+l) = h'\H(l,g)=h) (3.108) 
F2(H(g,g+l))P(Xg = 1\H(1, g) = h, H(g, g + 1) = h')a (3.109) 

This sum is less than the probability, given initial conditions 7^, that the zone of uncertainty 
will expand arbitarily far in both directions; however, by comparison to (3.87) through (3.92), 
it is seen to be greater than (3aj(l — e), with a, (3, and 7 depending only on the game, not on 
the initial conditions. If e is small enough, this contradicts the assumption that, given these 
conditions, this probability must be less than e. I 
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3.3 Standard Restricted Initial Conditions 



It may be useful to consider another form of finitely describable initial conditions, defined as 
follows: 

Definition 3.15 Standard restricted initial conditions are conditions such that there is 
a rightmost black cell, and a leftmost white cell. 

In other words, under standard restricted initial conditions, an infinite black domain is 
followed, left to right, by none, two, or any other even number of finite domains (of alternate 
colors), followed by an infinite white domain. 

The zone of uncertainty is defined similarly as for finitely describable initial conditions. 

Definition 3.16 Under standard restricted initial conditions, the zone of uncertainty con- 
sists those finite domains (if any), in between the two infinite domains. 

In some respects, the behavior of cellular games under these conditions is easier to analyze. 
That is, if there are finitely many black cells there is always positive probability that all black 
cells die out. This essentially ends the course of the game; thus, it makes it more awkward 
to discuss the long-term behavior of a system. Under standard restricted initial conditions, 
however, the two infinite domains cannot merge, and cells of each color will always be present. 

Behavior under standard restricted initial conditions can be delineated as follows: 

Theorem 3.17 Let G be a simple cellular game. Then, under standard restricted initial con- 
ditions, one, but not both, of the two statements below hold: 

1. The zone of uncertainty will, almost always, become empty infinitely many times. 

2. It will, almost always, become empty only finitely many times. 

Proof. Suppose G is such that, when the zone of uncertainty is empty, there is positive 
probability p it is for the last time. Then the probability that it will reach minimal size 
infinitely many times is 



n- 
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Definition 3.18 A clumping process is a simple cellular game in which, under standard 
restricted initial conditions, the zone of uncertainty almost always becomes empty infinitely 
many times. 

Definition 3.19 Let a simple cellular game in which this zone, almost always, becomes empty 
only finitely many times be called a mixing process. 

Now, there is another kind of symmetry which may be applied to cellular games; namely, 
they may be black/white symmetric, as well as left/right. 

We examine clumping processes which have both symmetries. We show that if G is a 
clumping process with both such symmetries, each cell will change color infinitely many times. 
To do this, we use a theorem which can be applied to all symmetric, one- dimensional random 
walks with the Markov property. In this theorem, we show that the walker will cross any 
position infinitely many times. (In the "usual" walk, in which the walker can only move one 
unit at a time, this means that the walker will visit every position infinitely many times.) 

Theorem 3.20 Let M be a one-dimensional random walk with the Markov property. Let X(t) 
be the position of that walk at time t. Let Po,i equal po > 0, Po,fc equal Pi^i^k\fi, and Po,fc 
equal Po,-fc for all k. Then, for any n, any g, and any value of X(g), the quantity P(3h,h > 
g,X(h) < n) equals P(3h,h > g,X(h) > n), and they both equal 1. That is, this random walk 
will almost always cross every position infinitely many times. 

Proof. First, the probability that the X(g) will stay bounded is 0. That is, suppose it were 
not. Then, there would be some n such that 

P(ra = limsup |X(A;)|) > (3.111) 

However, we know P-n,-n-i = Pn,n+i = Po > OVra. Therefore, if the walk reaches position 
n ( — n) infinitely often, it will almost always reach position ra + 1 ( — ra — 1) infinitely often. 

We now show that the probability that there are infinitely many k, such that X(k) is not 
the same sign as X(k + 1), is 1. 

Let a sequence {C'i} with each C'i G { — 1,1}, and integer sequences {ki} and {ni}, be 
constructed as follows: By the above discussion, we know that, with probability 1, there must 
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eventually be a A; for which > 2. Let ki be the first k for which this is true, and let 

m = X(ki). Let Ci be 1 if X(ki) > 2, and -1 if X(ki) < -2. 

Given C'i-i, fci-i, and such that X(ki) = rii, let C'i, ki, and rii be constructed as 

follows. Let ki be the first k such that \X(ki) — rii-i \ > rii-i ; note that there will almost always 
be such a ki. Let rii = X(ki), and let C'i = 1 if rii > 2raj_i, and —1 if rii < 2raj_i. Thus, if C'i is 
a different sign from C'i-i, then X(ki) will be a different sign from X(ki-i). 

Now, since Po,-fc = Po,k = P-n^n+k^n^k the probability that each is the same sign as the 
previous is |. Since the each Ci is independent of all others, they will, therefore, almost always 
change sign infinitely many times. 

The same argument can be used to show that, for any c, X{k) — c will change sign infinitely 
often, and hence that any point will be crossed infinitely many times. I 

Corollary 3.21 Let G he a clumping process with both left /right and black/ white symmetry. 
Let G evolve under standard restricted initial conditions. Then, under G, each cell will, almost 
always, change color infinitely many times. 

Proof. Let X(i) be the position of the leftmost cell in the white domain, the ith time the 
zone of uncertainty is empty. Then we know there will, almost always, be infinitely many X(i). 
Since cellular game evolution is independent of exact location, Po,fc = Pn;n+h/l'n,k. Since G is 
symmetric in both senses, Po,-fc will equal Po,fc for all k. 

Now, let a be the smallest probability that any cell lives, and [i the largest. By definition, 
they are both positive. Let the zone of uncertainty be empty in generation g for the ith time. 
There is probability at least a{l — (3)a that cell X(i) — 1 lives, cell X(i) dies, and cell X(i) + 1 
lives. Given these events, there is probability ^ that cell X(i) becomes white in the next 
generation, thus ensuring that X(i + 1) = X(i) + 1. Thus Px(i),X(i)+ij hence Po,i and Po,-i 
must be positive. Therefore the process X(0),X(1), . . .,X(n), . . . satisfies the requirements of 
the above theorem. I 

Similar results, however, have not yet been obtained for mixing processes. That is, we 
cannot show that for mixing processes with both left /right and black/ white symmetry, evolving 
under standard restricted initial conditions, the zone of uncertainty will, almost always, expand 
arbitrarily far in both directions. 
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As shown before, there cannot, under these conditions, be a "glider" with two domains of 
the same color on each side of it. This does not automatically imply that there cannot be a 
"glider" with two domains of different colors on each side of it. However, the one fact does 
suggest the other, which is here presented as a conjecture. 

Conjecture 3.22 Let G be a simple cellular game with both left/right and black/white sym- 
metry. Then, under standard restricted initial conditions, the probability that the zone of un- 
certainty will expand arbitrarily far in one direction only is 0. 

Note that if this conjecture is true, it can be shown that under both finite and standard 
restricted initial conditions, no finite domain D (with probability 1) will grow arbitrarily large. 
This would be done by considering the two areas between D and the infinite domains on the left 
and right to be gliders. Since D will grow arbitrarily large, each of these gliders could be shown 
not to be affected by what happens on the other side of _D. They could thus be considered to be 
"gliding" arbitrarily far in one direction, between two infinite domains. By Theorem 3.14 (The 
Double Glider Theorem), this is not possible if the two domains are the same color; and, if the 
above conjecture is true, this would not be possible if the two domains are different colors. 

3.4 Examples 

At this point, one may ask if either mixing processes or clumping processes exist. Computer 
simulations suggest that both kinds of behavior are indeed possible. 

The experiments described in this chapter simulate one- dimensional simple games of radius 
1. In these games, the life probability of a cell is one value, pi, if it is the same color as both 
of its neighbors, and a different value, p2, otherwise. These games are thus both left/right and 
black/white symmetric. Let such games be called "join/mix" processes. 

Using the definition of simple cellular game, these processes can be specified more formally 
as follows: 

• There is one cell for each integer, or each integer mod k. 

• In each generation, each cell is either white or black. 

• If a cell is the same color as both of its neighbors, its probability of living in that generation 
is pi > 0. Otherwise, its probability of living is p2 > 0. 
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• If a cell lives in a generation g, it keeps its color in generation g -\- 1. 

• If a cell dies in generation g, its color in generation ^ + 1 is either that of its nearest living 
neighbor to the left, or to the right, with a 50% probability of each. 

• If, in generation g, a cell has no living neighbors on each side, it has a 50% probability of 
assuming either color in generation g -\- 1. 

In computer experiments, games of this type are run on a circular lattice of cells. Initially, 
two black domains are placed in a mostly white area. Figure D.19 shows how results vary as 
Pi and p2 vary. That is, if pi is high, there seems to be little noise at the borders between 
domains. In such cases, p2 determines the rate of domain movement. If, on the other hand, pi 
is low and p2 high, the noise between domains seems to grow so fast it quickly takes over the 
ring. If pi and p2 are both low, the asymptotic behavior of the process is not readily apparent. 
However, the resemblance to natural structures is noticeable. 

Definition 3.23 The join/mix game such that pi = 0.85 and p2 = 0.15 is called the the Join 
or Die Process. 

The process is given this name because a cell must join; that is, be the same color as both of 
its neighbors, or else it is very likely to die. Computer simulations suggest that the Join or Die 
process is, in fact, a clumping process. That is, the area of "noise" between two large domains 
appears to stay, quite small most of the time. We thus conjecture: 

Conjecture 3.24 The Join or Die process is a clumping process. That is, if it evolves under 
standard restricted initial conditions, the zone of uncertainty will almost always become empty 
infinitely many times. 

Now, consider what happens, under the Join or Die or other clumping processes, to "normal" 
or "almost all" initial conditions. Let us suppose that average domain size will, almost always, 
grow arbitrarily large. Thus, after many generations, most cells in any given section of the 
lattice would, most likely, be in extremely large domains; and a visual depiction of this section 
would show large domains, with a noisy boundary between them (consisting of small domains, 
many containing no living cells). The noisy boundary between two such large domains would. 



68 



therefore, move in some sort of symmetric random walk; and it might be unlikely that the noise 
in the boundary would grow to significant size, compared to the domains it bordered. 

Thus, the evolution of such a process might be very similar to that of a process in which the 
size of the "noise" between domains stayed bounded. Let us suppose, without loss of generality, 
that the size of the "noise" stayed at one cell. Let us describe such a model (which is not a 
cellular game) as follows: 

• There is one cell for each integer. 

• Each cell, at each time, is in either a black, white, or gray state. 

• Gray domains, which may be no more than one cell wide, are called "particles." Particles 
separate black and white domains, which alternate. 

• Particles move either to the right or left, in accordance with some symmetric random 
walk. 

• If two particles meet or cross, then two white domains have absorbed a black domain (or 
two black domains a white one). Thus, these two particles, which represent the boundaries 
between two domains, disappear. 

This is, exactly, a stochastic process discovered by Erdos and Ney [5] and called the anni- 
hilating particle model. And, computer simulations do, indeed, show apparent similarities of 
behavior. These similarities suggest that study of one subject may shed light on the other. 

Another join/mix game is the Mixing Process. 

Definition 3.25 The join/mix game such that pi = 0.15 and p2 = 0.85 is called the the 
Mixing Process. 

That is, the probabilities are exactly reversed from those used for the Join or Die process. As 
this process evolves, computer experiments suggest that the "noise" between two large domains 
is likely to grow with time. 

Conjecture 3.26 The Mixing Process is a mixing process. That is, if it evolves under standard 
restricted initial conditions, the zone of uncertainty will almost always grow arbitrarily large. 
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Appendix A 

Computer Experiments 



All computer experiments were done in Turbo Pascal, Version 4.0, using the built-in pseudo- 
random number generator. Source code is available from levine@symcom.math.uiuc.edu. 

The program simulating the modified Arthur-Packard- Rogers model, with Stag Hunt pa- 
rameters, is cg2.pas. Note that in this program all strategies are mixed; that is, there is a 
small probability of actions other than those called for by the pure strategy. 

The simulations of zero-depth, one-round models are as follows: In Section 2: The Cloud 
Process, cloud. pas, the Prisoner's Dilemma, prisoner .pas, the Stag Hunt (first version), 
stag. pas, and the Stag Hunt (second version), stag2.pas. In Section 3: The square of different 
join/mix processes, square. pas, the Join or Die Process, jd.pas, the annihilating particle 
model, apm.pas, and the Mixing Process, mix. pas. 
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Appendix B 

The Prisoner's Dilemma 



The Prisoner's Dilemma is a two-person game in which two types of moves are possible: coop- 
erate, and defect. This game models the options of two prisoners held in separate cells for the 
same crime, who are being pressured to confess to that crime. 

If both prisoners keep silent - that is, they cooperate with each other - they will both get 
a small sentence for a lesser crime. If they both talk - that is, they both defect - they both 
get the standard sentence. If one talks and the other does not, the one that kept silent gets 
a very severe sentence and the other goes free. Thus, Prisoner's Dilemma is a game in which 
a player's reward for defecting, while the other player cooperates, is highest. Next highest is 
the reward for mutual cooperation; then, the reward for mutual defection. Lowest of all is the 
reward for cooperating while the other player defects. 

The Prisoner's Dilemma can also be generalized to three-person games. For more informa- 
tion on the Prisoner's Dilemma, see [1] and [18]. 
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Appendix C 



The Arthur-Packard-Rogers Model 

The computer experiments presented in 2.2 use a model very similar to the one described in 
[20]. 

That is, there exists a circular ring, or doubly infinite lattice, of cells C . Associated with 
each cell c, in each round i of each generation g, are: 

• A move variable rric^i^g from some finite alphabet T, of k characters. 

• A strategy variable Sc,g- This is a table, in which entries are from S. If strategies are of 
depth d and radius r (that is, moves of the r nearest neighbors of a cell, up to d rounds 
back, are taken into account), then this table contains entries. There are hence 
^^d(2r+i) pQggji^^g strategies. Note that strategies do not change in a generation, but they 
do take into account rounds in previous generations. In computer experiments, move and 
strategy variables are initialized with the aid of a pseudorandom number generator. 

A finite number of mixed, that is, stochastic, strategies may also be implemented; that is, 
strategies in which, given at least one game history, there is positive probability of a cell 
making two different moves. For example, a mixed strategy for Prisoner's Dilemma would 
be to cooperate 95% of the time, and defect the other 5%. If a given game allows k moves, 
and k' mixed courses of action, there are (k + k' )'^'"'^'^'^^^ possible strategies. Again, mixed 
strategies, and all other stochastic actions, are implemented with the aid of a generator. 

• A reward, or payoff, variable Wc^i^g- This variable starts out at in the first round of each 
generation, and its change in each round measures the success of a cell in that round. 
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Changes to the reward variable are determined by a matrix G. This matrix defines the 
game and does not change during its course. That is, if a cellular game has radius r, and i > 1, 

Wc,^,g = Wc,t-l,g + G[mc-r,t,g, . . . , nic^t^g, . . . , mc+r,t,g] (C.l) 

An example of a game matrix is this table for a Prisoner's Dilemma game: That is, if "D" 
is defect, and "C" is cooperate: G[CDC] = 100, G[CDD] = G[DDC] = 70, G[CCC] = 60, 
G[DDD] = 40, G[DCC] = G[CCD] = 30,G[DCD] = 0. For this game, k = 2 (that is, there 
are two possible moves, cooperate or defect); and r = 1 (only the moves of the nearest neighbors 
of a cell affect its reward variable). 

In the Arthur-Packard- Rogers model, a fixed number of rounds R (e.g., 150 rounds), is 
regarded as constituting a generation. After each generation, cell strategies change, as follows: 

• The probability of a cell "living" into the next generation, is an increasing function of the 
size of its reward variable. Usually the reward matrix contains only positive entries, and 
life probability is proportional to the size of the reward variable of a cell. 

• A live cell keeps its strategy in the next generation. 

• A cell that does not live is given a new strategy in the next generation. This strategy is 
chosen as follows: 

• New entries in the strategy table are taken from corresponding entries in either one of the 
two parent cells (the nearest living neighbors of a cell on each side). The new strategy 
table can contain elements from both parent cells (crossover. Definition 2.4) or only from 
one parent (no crossover). The exact details of how such a selection is carried is part of 
the genetic algorithm used in the program. For a discussion of genetic algorithms, see 
[6]. Note, however, that all such algorithms are symmetric between the left and right 
parent; and that if a cell has no living neighbors on either side, all strategy possibilities 
are equally likely. 

• After the basic new strategy is chosen, each table entry is subject to mutation (Definition 
2.6). That is, there is a small probability it may change. 
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Appendix D 

Figures 
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Figure D.l: Computer simulation of the Stag Hunt, a modified Arthur-Packard- Rogers cel- 
lular game model, with 75 cells, and 150 generations per round. Program cg2.pas, random 
seed 824709136, generation 1. In this program, all initial strategies are depth 1, but strategies 
of depth up to 3 may be introduced as the system evolves. 
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Figure D.2: The same program, parameters, and seed as above, generation 27. Notice the 
rightward-moving waves of cooperative behavior, in the right part of the display. Here some 
zones exhibit cellular automaton-like triangular patterns. 
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Figure D.3: Generation 139 of this run. Cellular automaton-like triangles predominate in this 
figure. 
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Figure D.4: Generation 165. There are now leftward-moving waves of cooperative behavior, 
in the middle of the display. 
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Figure D.5: Generation 305. 
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Figure D.6: Generation 483. Cellular automaton-like triangles appear again. 
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Figure D.7: Generation 560. Move behavior does not appear to have changed much in many 
generations. 
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Figure D.8: Generation 561. An all-cooperate zone appears. The next three figures show the 
rapid growth of this zone. 
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Figure D.IO: Generation 658. 
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Figure D.ll: Generation 662. The all-cooperate zone has almost completely taken over the 
ring. 
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Figure D.12: Generation 930. Large all-cooperate zones have predominated in the past several 
hundred generations. However, at this point, a perturbation in strategy - that is, an unexpected 
defect move - can set off many defect moves in other cells. 
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Figure D.13: Generation 982. Recovery of an all-cooperate zone. 
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Figure D.14: Generation 1262. At this point, perturbations do not set off much defecting 
behavior in other cells. That is, strategies are no longer, "Cooperate unless there are defectors 
in the neighborhood," but, "Cooperate, whatever happens." 
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Figure D.15: Computer simulation of a one-round cellular game, the Cloud Process, on a 
ring of 640 cells. The table for this game is: G(BBB) = G(WWW) = 0.27, G(BBW) = 
G(BWB) = G(BWW) = G(WBB) = G(WBW) = G(WWB) = 0.53. Program cloud. pas, 
random seed 118950941. Initial conditions were chosen with the aid of a pseudorandom number 
generator. 
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Figure D.16: Computer simulation of a one-round Prisoner's Dilemma game on a ring of 600 
cells. Initially, two defectors are placed side-by- side; all other cells are cooperators. (Black indi- 
cates defecting cells, and white, cooperating.) Program prisoner .pas, random seed 424479774. 
Note that the rate of expansion of the black domain appears roughly similar on each side, thus 
suggesting an informal estimate of the expected rate. 
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Figure D.17: Computer simulation of a zero-depth, one round per generation Stag Hunt 
game on a ring of 600 cells. Initially, four cooperators are placed contiguously; all other cells 
are defectors. Program stag. pas, random seed 941165838. Note that, in this case, the rate of 
expansion of the white domain appears to vary considerably. 
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Figure D.18: Computer simulation of a zero-depth, one round per generation Stag Hunt 
game on a ring of 600 cells. Initially, four defectors are placed contiguously; all other cells are 
cooperators. Program stag2.pas, random seed 90049811. 



92 



□ .85 



□ . SO 



□ . 15 




□.15 0.50 0.85 

Figure D.19: Join/mix processes with various parameters. Each process is run on a circular 
lattice of 165 cells for 125 generations. Initially, all cells are white except for cells 48 through 
70, and 95 through 117. The numbers at the bottom show the values of pi; and those on the 
left show the values of p2- That is, both pi and p2 are set at 0.15, 0.50, and 0.85. The program 
used is square. pas, seed 252644401. 
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Figure D.20: Computer simulation of the Join or Die Process on a ring of 640 cells. Initial 
conditions are black for cells through 127, and 512 through 639, and white for cells 128 
through 511. Program jd.pas, random seed 274535429. 
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Figure D.21: Computer simulation of the Join or Die Process. Initial conditions were chosen 
with the aid of a pseudorandom number generator, so each cell is equally likely to be black 
or white. Random seed 705238026 is used; and the same program, and ring size, as in the 
preceding figure. 



95 



Figure D.22: The annihilating particle model, on a ring of 640 cells, which initially contains 
28 particles. Program apm.pas, seed 269093635. Each particle executes a symmetric random 
walk, having a 50% probability of going either left or right in each generation. 
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Figure D.23: Computer simulation of the Mixing Process on a ring of 640 cells. Initial 
conditions are black for cells through 127, and 512 through 639, and white for cells 128 
through 511. Program mix. pas, random seed 912200719. 
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